x Take the InfoQ Survey !
Older Newer rss

Lightning Fast Cluster Computing with Spark and Cassandra

Posted by Piotr Kołaczkowski  on  Jun 17, 2015

Piotr Kołaczkowski discusses how they integrated Spark with Cassandra, how it was done, how it works in practice and why it is better than using a Hadoop intermediate layer.


Translating Imperative Code to MapReduce

Posted by Cosmin Radoi, Rodric Rabbah, Stephen J Fink, Manu Sridharan  on  Jun 10, 2015

The authors present an approach for automatic translation of sequential, imperative code into a parallel MapReduce framework using Mold, translating Java code to run on Apache Spark.


Understanding Cloud, Big Data, Mobile and Security – Do They Play Nicely Together?

Posted by Colin Mower  on  May 12, 2015

Colin Mower discusses the challenges met using together Cloud, Big Data, Mobile and Security and how these can work together to achieve business value.


A Taste of Random Decision Forests on Apache Spark

Posted by Sean Owen  on  Apr 28, 2015

Sean Owen introduces Spark, Scala and random decision forests, and demonstrates the process of analyzing a real-world data set with them.


Big Data in Memory

Posted by John Davies  on  Mar 14, 2015

John Davies shows a Spring work-flow consuming 7.4kB XML messages, binding them to 25kB Java but storing them in just 450 bytes each, 10 million derivative contracts in-memory on a laptop.


Gobblin: A Framework for Solving Big Data Ingestion Problem

Posted by Lin Qiao  on  Mar 12, 2015

Lin Qiao discusses the architecture of Gobblin, LinkedIn’s framework for addressing the need of high quality and high velocity data ingestion.


Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets

Posted by Eugene Mandel  on  Mar 12, 2015

Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.


High Performance Computing Contributions to the World of Big Data

Posted by Sharan Kalwani  on  Jan 11, 2015

Sharan Kalwani presents the history of HPC and the technologies and trends which have contributed to creating the world of big data, covering applications of HPC resulting in big data technologies.


A Distributed Transactional Database on Hadoop

Posted by John Leach  on  Jan 02, 2015

John Leach explains using HBase co-processors to support a full ANSI SQL RDBMS without modifying the core HBase source, showing how Hadoop/HBase can replace traditional RDBMS solutions.


Hadoop 201 -- Deeper into the Elephant

Posted by Roman Shaposhnik  on  Dec 28, 2014

Roman Shaposhnik discusses more advanced features of HDFS, in addition to how YARN has enabled businesses to massively scale their systems beyond what was previously possible.


Why Would You Integrate Solr and Hadoop?

Posted by Yann Yu  on  Dec 28, 2014

Yann Yu discusses how Solr and Hadoop complement each other, and how to use Solr as a real-time, analytical, full-text search front-end to data stored in Hadoop.


1.5 Million Log Lines Per Second: Building and Maintaining Flume Flows at Conversant

Posted by Mike Keane  on  Dec 21, 2014

Mike Keane presents how Conversant migrated to Flume, managing 1000 agents across 4 data centers, processing over 50B log lines per day with peak hourly averages of over 1.5 million log lines/sec.

General Feedback
Marketing and all content copyright © 2006-2015 C4Media Inc. hosted at Contegix, the best ISP we've ever worked with.
Privacy policy