BT
Older rss
Architecture & Design Follow 2020 Followers

Is Batch ETL Dead, and is Apache Kafka the Future of Data Processing?

Posted by Daniel Bryant Follow 667 Followers on  Jan 22, 2018

At QCon San Francisco 2016, Neha Narkhede presented “ETL is Dead; Long Live Streams”, and discussed the changing landscape of enterprise data processing. 5

Mobile Follow 144 Followers

Processing Streaming Human Trajectories with WSO2 CEP

Posted by Ramindu De Silva Follow 0 Followers , Miyuru Dayarathna Follow 0 Followers on  Feb 27, 2017

Extracting useful information from inaccurate data stream, such as human trajectories, is a key issue in IoT applications. This problem can be successfully tackled with Kalman filters.

Architecture & Design Follow 2020 Followers

Key Takeaway Points and Lessons Learned from QCon San Francisco 2016

Posted by Abel Avram Follow 7 Followers on  Dec 14, 2016

The 10th annual QCon San Francisco was the biggest yet, bringing together over 1500 team leads, architects, project managers, and engineering directors.

AI, ML & Data Engineering Follow 815 Followers

Traffic Data Monitoring Using IoT, Kafka and Spark Streaming

Posted by Amit Baghel Follow 0 Followers on  Sep 28, 2016

Internet of Things (IoT) is an emerging technology. One of the areas of IoT is the connected vehicles. In this article, we'll use Spark and Kafka to analyse and process IoT connected vehicle's data. 16

AI, ML & Data Engineering Follow 815 Followers

Chris Fregly on the PANCAKE STACK Workshop and Data Pipelines

Posted by Dylan Raithel Follow 9 Followers on  Aug 29, 2016

InfoQ interviews Chris Fregly, organizer for the 4000+ member Advanced Spark and TensorFlow Meetup about the PANCAKE STACK workshop, Spark and building data pipelines for a machine learning pipeline

AI, ML & Data Engineering Follow 815 Followers

Big Data Processing with Apache Spark - Part 3: Spark Streaming

Posted by Srini Penchikala Follow 34 Followers on  Jan 07, 2016

In this article, third installment of Apache Spark series, author discusses Apache Spark Streaming framework for processing real-time streaming data using a log analytics sample application. 7

Followers

Storm Applied Review and Q&A with the Authors

Posted by Sergio De Simone Follow 14 Followers on  Jul 27, 2015

Storm Applied is a new book from Manning that aims to provide a practical guide on using Storm, both in a development and in a production setting. InfoQ has spoken with two of the book’s authors.

AI, ML & Data Engineering Follow 815 Followers

Big Data Processing with Apache Spark - Part 2: Spark SQL

Posted by Srini Penchikala Follow 34 Followers on  Apr 16, 2015

Spark SQL, part of Apache Spark, is used for structured data processing by running SQL queries on Spark data. Srini Penchikala discusses Spark SQL module & how it simplifies data analytics using SQL. 1

AI, ML & Data Engineering Follow 815 Followers

Big Data Processing with Apache Spark – Part 1: Introduction

Posted by Srini Penchikala Follow 34 Followers on  Jan 30, 2015

Apache Spark is an open source big data framework built around speed, ease of use, and sophisticated analytics. In this article, Srini Penchikala discusses how Spark helps with big data processing. 8

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT