x Take the InfoQ Survey !
Older Newer rss

Understanding Cloud, Big Data, Mobile and Security – Do They Play Nicely Together?

Posted by Colin Mower  on  May 12, 2015

Colin Mower discusses the challenges met using together Cloud, Big Data, Mobile and Security and how these can work together to achieve business value.


A Taste of Random Decision Forests on Apache Spark

Posted by Sean Owen  on  Apr 28, 2015

Sean Owen introduces Spark, Scala and random decision forests, and demonstrates the process of analyzing a real-world data set with them.


Big Data in Memory

Posted by John Davies  on  Mar 14, 2015

John Davies shows a Spring work-flow consuming 7.4kB XML messages, binding them to 25kB Java but storing them in just 450 bytes each, 10 million derivative contracts in-memory on a laptop.


Gobblin: A Framework for Solving Big Data Ingestion Problem

Posted by Lin Qiao  on  Mar 12, 2015

Lin Qiao discusses the architecture of Gobblin, LinkedIn’s framework for addressing the need of high quality and high velocity data ingestion.


Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets

Posted by Eugene Mandel  on  Mar 12, 2015

Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.


High Performance Computing Contributions to the World of Big Data

Posted by Sharan Kalwani  on  Jan 11, 2015

Sharan Kalwani presents the history of HPC and the technologies and trends which have contributed to creating the world of big data, covering applications of HPC resulting in big data technologies.


A Distributed Transactional Database on Hadoop

Posted by John Leach  on  Jan 02, 2015

John Leach explains using HBase co-processors to support a full ANSI SQL RDBMS without modifying the core HBase source, showing how Hadoop/HBase can replace traditional RDBMS solutions.


Hadoop 201 -- Deeper into the Elephant

Posted by Roman Shaposhnik  on  Dec 28, 2014

Roman Shaposhnik discusses more advanced features of HDFS, in addition to how YARN has enabled businesses to massively scale their systems beyond what was previously possible.


Why Would You Integrate Solr and Hadoop?

Posted by Yann Yu  on  Dec 28, 2014

Yann Yu discusses how Solr and Hadoop complement each other, and how to use Solr as a real-time, analytical, full-text search front-end to data stored in Hadoop.


1.5 Million Log Lines Per Second: Building and Maintaining Flume Flows at Conversant

Posted by Mike Keane  on  Dec 21, 2014

Mike Keane presents how Conversant migrated to Flume, managing 1000 agents across 4 data centers, processing over 50B log lines per day with peak hourly averages of over 1.5 million log lines/sec.


The Big Data Imperative: Discovering & Protecting Sensitive Data in Hadoop

Posted by Jeremy Stieglitz  on  Dec 21, 2014

Jeremy Stieglitz discusses best practices for a data-centric security , compliance and data governance approach, with a particular focus on two customer use cases.


Why Spark Is the Next Top (Compute) Model

Posted by Dean Wampler  on  Dec 15, 2014

Dean Wampler argues that Spark/Scala is a better data processing engine than MapReduce/Java because tools inspired by mathematics, such as FP, are ideal tools for working with data.

General Feedback
Marketing and all content copyright © 2006-2015 C4Media Inc. hosted at Contegix, the best ISP we've ever worked with.
Privacy policy