Ready for InfoQ 3.0? Try the new design and let us know what you think!

Older rss
Architecture & Design Follow 2650 Followers

A Critique of Resizable Hash Tables: Riak Core & Random Slicing

Posted by Scott Lystig Fritchie Follow 0 Followers on  Aug 26, 2018

This fall, Wallaroo Labs will be releasing a large new feature set to our distributed data stream processing framework, Wallaroo.

AI, ML & Data Engineering Follow 1118 Followers

How to Choose a Stream Processor for Your App

Posted by Srinath Perera Follow 2 Followers , Miyuru Dayarathna Follow 0 Followers on  Aug 21, 2018

In this article, authors discuss reference architecture of stream processor technologies and key features required by most streaming applications. 2

AI, ML & Data Engineering Follow 1118 Followers

Democratizing Stream Processing with Apache Kafka and KSQL - Part 1

Posted by Michael Noll Follow 0 Followers on  Jun 15, 2018

In this article, author discusses the stream processing with KSQL, the streaming SQL engine for Apache Kafka. Topics covered include challenges of stateful stream processing & how KSQL addresses them. 1


Virtual Panel: Succeeding with Event Sourcing

Posted by Richard Seroter Follow 8 Followers on  Feb 15, 2018

Why should you use event sourcing as a data storage and retrieval technique? What are the implications? When should you use platforms versus frameworks? InfoQ interviewed two experts to learn more.

AI, ML & Data Engineering Follow 1118 Followers

Migrating Batch ETL to Stream Processing: A Netflix Case Study with Kafka and Flink

Posted by Daniel Bryant Follow 827 Followers on  Feb 08, 2018

At QCon NY, Shriya Arora presented “Personalising Netflix with Streaming Datasets” and discussed a migration of a data processing job from batch-style ETL to stream processing using Apache Flink.

Architecture & Design Follow 2650 Followers

Exploring the Fundamentals of Stream Processing with the Dataflow Model and Apache Beam

Posted by Daniel Bryant Follow 827 Followers on  Jan 30, 2018

At QCon SF 2016, Frances Perry and Tyler Akidau presented “Fundamentals of Stream Processing with Apache Beam”, and discussed Google's Dataflow model and associated implementation of Apache Beam.

Architecture & Design Follow 2650 Followers

Is Batch ETL Dead, and is Apache Kafka the Future of Data Processing?

Posted by Daniel Bryant Follow 827 Followers on  Jan 22, 2018

At QCon San Francisco 2016, Neha Narkhede presented “ETL is Dead; Long Live Streams”, and discussed the changing landscape of enterprise data processing. 5

Architecture & Design Follow 2650 Followers

Events, Flows and Long-Running Services: A Modern Approach to Workflow Automation

Posted by Martin Schimak Follow 11 Followers , Bernd Rücker Follow 10 Followers on  Dec 21, 2017

Although domain events can decrease coupling within a microservice architecture, we must avoid the mistakes of SOA: no centralised control, and workflow engines must be less painful to use and operate 7

Development Follow 786 Followers

Key Takeaway Points and Lessons Learned from QCon San Francisco 2017

Posted by Abel Avram Follow 12 Followers on  Dec 14, 2017

The eleventh annual QCon San Francisco was the biggest yet, bringing together over 1,800 team leads, architects, project managers, and engineering directors. 1