Older rss
AI, ML and Data Engineering Follow 641 Followers

Kafka Streams - from the Ground Up to the Cloud

Posted by Marius Bogoevici  on  Mar 01, 2018 Posted by Marius Bogoevici Follow 1 Followers  on  Mar 01, 2018

Marius Bogoevici introduces the Kafka Streams API and the Kafka Streams processing engine, showing how to write and deploy Kafka Streams applications using Spring Cloud Stream.

AI, ML and Data Engineering Follow 641 Followers

Data Decisions with Real-Time Stream Processing

Posted by Serhat Yilmaz  on  Feb 28, 2018 Posted by Serhat Yilmaz Follow 0 Followers  on  Feb 28, 2018

Serhat Yilmaz talks about how Facebook is using stream processing at scale, the difficulties they have encountered and the solutions they have created to date.

AI, ML and Data Engineering Follow 641 Followers

Streaming SQL Foundations: Why I ❤Streams+Tables

Posted by Tyler Akidau  on  Feb 17, 2018 Posted by Tyler Akidau Follow 0 Followers  on  Feb 17, 2018

Tyler Akidau explores the relationship between the Beam Model and stream & table theory, stream processing in SQL with Apache Beam, Calcite, Flink, Kafka KSQL and Apache Spark’s Structured streaming.

AI, ML and Data Engineering Follow 641 Followers

The Power of Distributed Snapshots in Apache Flink

Posted by Stephan Ewen  on  Feb 16, 2018 Posted by Stephan Ewen Follow 0 Followers  on  Feb 16, 2018

Stephan Ewen talks about how Apache Flink handles stateful stream processing and how to manage distributed stream processing & data driven applications efficiently with Flink's checkpoints&savepoints.

AI, ML and Data Engineering Follow 641 Followers

Panel: SQL over Streams, Ask the Experts

Posted by Tyler Akidau  on  Dec 05, 2017 Posted by Tyler Akidau Follow 0 Followers , Stephan Ewen Follow 0 Followers , Michael Armbrust Follow 0 Followers , Jay Kreps Follow 1 Followers , Julian Hyde Follow 0 Followers  on  Dec 05, 2017

The panelists discuss the new generation of Stream Processing engines.

Architecture & Design Follow 1625 Followers

Survival of the Fittest - Streaming Architectures

Posted by Michael Hansen  on  Jul 26, 2017 Posted by Michael Hansen Follow 1 Followers  on  Jul 26, 2017

Michael Hansen talks about the core principles that will stand the tests of streaming evolution, the potential pitfalls that we may stumble over on our path to streaming and how to avoid these.

AI, ML and Data Engineering Follow 641 Followers

Streaming for Personalization Datasets at Netflix

Posted by Shriya Arora  on  Jul 26, 2017 Posted by Shriya Arora Follow 0 Followers  on  Jul 26, 2017

Shriya Arora discusses challenges faced with stream processing unbounded datasets, comparing microbatch with event-based approaches using Spark and Flink.

Architecture & Design Follow 1625 Followers

Streaming Microservices: Contracts & Compatibility

Posted by Gwen Shapira  on  Jul 25, 2017 Posted by Gwen Shapira Follow 1 Followers  on  Jul 25, 2017

Gwen Shapira discusses patterns of schema design, schema storage and schema evolution that help development teams build contracts through better collaboration and deliver resilient applications faster

AI, ML and Data Engineering Follow 641 Followers

Adopting Stream Processing for Instrumentation

Posted by Sean Cribbs  on  Jul 19, 2017 Posted by Sean Cribbs Follow 0 Followers  on  Jul 19, 2017

Sean Cribbs talks about the interface Comcast has designed for their instrumentation system, how it works, how the stream processor manages flows on behalf of the user, and some trade-offs applied.

AI, ML and Data Engineering Follow 641 Followers

When Streams Fail: Kafka Off the Shore

Posted by Anton Gorshkov  on  Jul 18, 2017 1 Posted by Anton Gorshkov Follow 0 Followers  on  Jul 18, 2017 1

Anton Gorshkov discusses how to evaluate and architect a resilient streaming platform, focusing on Kafka and Spark streaming and sharing his experience of using them to process financial transactions.

Java Follow 713 Followers

Real-World Java 9

Posted by Trisha Gee  on  Jun 09, 2017 Posted by Trisha Gee Follow 3 Followers  on  Jun 09, 2017

Trisha Gee shows via live coding how we can use the new Flow API to utilize Reactive Programming, how the improvements to the Streams API make it easier to control real-time streaming data, etc.

Architecture & Design Follow 1625 Followers

From Concurrent to Parallel

Posted by Brian Goetz  on  Jun 09, 2017 1 Posted by Brian Goetz Follow 8 Followers  on  Jun 09, 2017 1

Brian Goetz explores the different goals, tools, and techniques involved between concurrency and parallelism approaches, and how to analyze a computation for potential parallelism.

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you