Older rss
Architecture & Design Follow 2412 Followers

RDBMS and Apache Geode Data Movement: Low Latency ETL Pipeline by Using Cloud-Native Event Driven Microservices

Posted by Paul Warren  on  Jun 30, 2018 Posted by Paul Warren Follow 0 Followers , Heather Riddle Follow 0 Followers  on  Jun 30, 2018

Paul Warren, Heather Riddle discuss how to create cloud-native event driven microservices for RDBMS and Apache Geode by using Cloud Foundry, Spring Cloud Stream, and RabbitMQ/Kafka.

Architecture & Design Follow 2412 Followers

Cloud-Native and Scalable Kafka Architecture

Posted by Allen Wang  on  Apr 12, 2018 Posted by Allen Wang Follow 0 Followers  on  Apr 12, 2018

Allen Wang talks about how Netflix addresses the issues of stability and scalability in a cloud environment by having many smaller and mostly immutable Kafka clusters with limited state changes.

Java Follow 1096 Followers

What's New in Spring for Apache Kafka 2.0

Posted by Gary Russell  on  Mar 22, 2018 Posted by Gary Russell Follow 0 Followers  on  Mar 22, 2018

Gary Russell discusses Spring's support for Kafka including better threading and a new consumer-aware listener.

AI, ML & Data Engineering Follow 992 Followers

Kafka Streams - from the Ground Up to the Cloud

Posted by Marius Bogoevici  on  Mar 01, 2018 Posted by Marius Bogoevici Follow 1 Followers  on  Mar 01, 2018

Marius Bogoevici introduces the Kafka Streams API and the Kafka Streams processing engine, showing how to write and deploy Kafka Streams applications using Spring Cloud Stream.

AI, ML & Data Engineering Follow 992 Followers

Streaming SQL Foundations: Why I ❤Streams+Tables

Posted by Tyler Akidau  on  Feb 17, 2018 Posted by Tyler Akidau Follow 1 Followers  on  Feb 17, 2018

Tyler Akidau explores the relationship between the Beam Model and stream & table theory, stream processing in SQL with Apache Beam, Calcite, Flink, Kafka KSQL and Apache Spark’s Structured streaming.

Architecture & Design Follow 2412 Followers

Cloud Event-Driven Architectures with Spring Cloud Stream 2.0

Posted by Oleg Zhurakousky  on  Feb 01, 2018 2 Posted by Oleg Zhurakousky Follow 0 Followers  on  Feb 01, 2018 2

Oleg Zhurakousky overviews various types of event-driven architectures, and how the different message-oriented components of the Spring portfolio fit into the picture.

AI, ML & Data Engineering Follow 992 Followers

When Streams Fail: Kafka Off the Shore

Posted by Anton Gorshkov  on  Jul 18, 2017 1 Posted by Anton Gorshkov Follow 0 Followers  on  Jul 18, 2017 1

Anton Gorshkov discusses how to evaluate and architect a resilient streaming platform, focusing on Kafka and Spark streaming and sharing his experience of using them to process financial transactions.

AI, ML & Data Engineering Follow 992 Followers

Real-Time Recommendations Using Spark Streaming

Posted by Elliot Chow  on  Mar 30, 2017 Posted by Elliot Chow Follow 0 Followers  on  Mar 30, 2017

Elliot Chow discusses the data pipeline that they built with Kafka, Spark Streaming, and Cassandra to process Netflix user activities in real time for the Trending Now row.

AI, ML & Data Engineering Follow 992 Followers

I Can't Believe It's Not a Queue: Using Kafka with Spring

Posted by Joe Kutner  on  Jan 29, 2017 Posted by Joe Kutner Follow 0 Followers  on  Jan 29, 2017

Joe Kutner talks about Kafka and where it fits in a Spring app and how to make it do things message queues simply can't.

AI, ML & Data Engineering Follow 992 Followers

Reactive Kafka

Posted by Rajini Sivaram  on  Jan 14, 2017 1 Posted by Rajini Sivaram Follow 0 Followers  on  Jan 14, 2017 1

Rajini Sivaram talks about Kafka and reactive streams and then explores the development of a reactive streams interface for Kafka and the use of this interface for building robust applications.

Java Follow 1096 Followers

Spring for Apache Kafka

Posted by Gary Russell  on  Jan 12, 2017 Posted by Gary Russell Follow 0 Followers  on  Jan 12, 2017

Gary Russell takes a look at the features of the spring-kafka project as well as the new version (2.0) of spring-integration-kafka which is now based on the Spring for Apache Kafka project.

AI, ML & Data Engineering Follow 992 Followers

ETL Is Dead, Long Live Streams

Posted by Neha Narkhede  on  Dec 06, 2016 1 Posted by Neha Narkhede Follow 2 Followers  on  Dec 06, 2016 1

Neha Narkhede shares the experience at LinkedIn moving from ETL to real-time streams, the challenges of scaling Kafka to hundreds of billions of events/day, supporting thousands of engineers, etc.

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you