x Take the InfoQ Survey !
Older Newer rss

Gobblin: A Framework for Solving Big Data Ingestion Problem

Posted by Lin Qiao  on  Mar 12, 2015

Lin Qiao discusses the architecture of Gobblin, LinkedIn’s framework for addressing the need of high quality and high velocity data ingestion.


Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets

Posted by Eugene Mandel  on  Mar 12, 2015

Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.


High Performance Computing Contributions to the World of Big Data

Posted by Sharan Kalwani  on  Jan 11, 2015

Sharan Kalwani presents the history of HPC and the technologies and trends which have contributed to creating the world of big data, covering applications of HPC resulting in big data technologies.


A Distributed Transactional Database on Hadoop

Posted by John Leach  on  Jan 02, 2015

John Leach explains using HBase co-processors to support a full ANSI SQL RDBMS without modifying the core HBase source, showing how Hadoop/HBase can replace traditional RDBMS solutions.


Hadoop 201 -- Deeper into the Elephant

Posted by Roman Shaposhnik  on  Dec 28, 2014

Roman Shaposhnik discusses more advanced features of HDFS, in addition to how YARN has enabled businesses to massively scale their systems beyond what was previously possible.


Why Would You Integrate Solr and Hadoop?

Posted by Yann Yu  on  Dec 28, 2014

Yann Yu discusses how Solr and Hadoop complement each other, and how to use Solr as a real-time, analytical, full-text search front-end to data stored in Hadoop.


1.5 Million Log Lines Per Second: Building and Maintaining Flume Flows at Conversant

Posted by Mike Keane  on  Dec 21, 2014

Mike Keane presents how Conversant migrated to Flume, managing 1000 agents across 4 data centers, processing over 50B log lines per day with peak hourly averages of over 1.5 million log lines/sec.


The Big Data Imperative: Discovering & Protecting Sensitive Data in Hadoop

Posted by Jeremy Stieglitz  on  Dec 21, 2014

Jeremy Stieglitz discusses best practices for a data-centric security , compliance and data governance approach, with a particular focus on two customer use cases.


Why Spark Is the Next Top (Compute) Model

Posted by Dean Wampler  on  Dec 15, 2014

Dean Wampler argues that Spark/Scala is a better data processing engine than MapReduce/Java because tools inspired by mathematics, such as FP, are ideal tools for working with data.


Unified Big Data Processing with Apache Spark

Posted by Matei Zaharia  on  Dec 11, 2014

Matei Zaharia talks about the latest developments in Spark and shows examples of how it can combine processing algorithms to build rich data pipelines in just a few lines of code.


Customer Analytics on Hadoop

Posted by Bob Kelly  on  Dec 07, 2014

Bob Kelly presents case studies on how Platfora uses Hadoop to do analytics for several of their customers.


Unleash the Power of HBase Shell

Posted by Jayesh Thakrar  on  Dec 07, 2014

Jayesh Thakrar shows what can be done with irb, how to exploit JRuby-Java integration, and demonstrates how the Shell can be used in Hadoop streaming to perform complex and large volume batch jobs.

General Feedback
Marketing and all content copyright © 2006-2015 C4Media Inc. hosted at Contegix, the best ISP we've ever worked with.
Privacy policy