Articles
-
AI, ML & Data Engineering AI, ML & Data Engineering Follow 760 Followers
Democratizing Stream Processing with Apache Kafka and KSQL
In this article, author Michael Noll discusses the stream processing with KSQL, the streaming SQL engine for Apache Kafka. Topics covered include challenges of stateful stream processing and how KSQL addresses them, and how KSQL helps to bridge the world of streams and databases through streams and tables.
-
AI, ML & Data Engineering AI, ML & Data Engineering Follow 760 Followers
Migrating Batch ETL to Stream Processing: A Netflix Case Study with Kafka and Flink
At QCon New York, Shriya Arora presented “Personalising Netflix with Streaming Datasets” and discussed the trials and tribulations of a recent migration of a Netflix data processing job from the traditional approach of batch-style ETL to stream processing using Apache Flink.
-
Architecture & Design Architecture & Design Follow 1877 Followers
Exploring the Fundamentals of Stream Processing with the Dataflow Model and Apache Beam
At QCon San Francisco 2016, Frances Perry and Tyler Akidau presented “Fundamentals of Stream Processing with Apache Beam”, and discussed Google's Dataflow model and associated implementation of Apache Beam.
Is Batch ETL Dead, and is Apache Kafka the Future of Data Processing?
Processing Streaming Human Trajectories with WSO2 CEP
Extracting useful information from inaccurate data stream, such as human trajectories, is a key issue in IoT applications. This problem can be successfully tackled with Kalman filters.
Key Takeaway Points and Lessons Learned from QCon San Francisco 2016
The 10th annual QCon San Francisco was the biggest yet, bringing together over 1500 team leads, architects, project managers, and engineering directors.
Big Data Processing with Apache Spark - Part 3: Spark Streaming
Storm Applied Review and Q&A with the Authors
Storm Applied is a new book from Manning that aims to provide a practical guide on using Storm, both in a development and in a production setting. InfoQ has spoken with two of the book’s authors.
Real-Time Stream Processing as Game Changer in a Big Data World with Hadoop and Data Warehouse
