BT
Older rss
  • AI, ML & Data Engineering Follow 990 Followers

    Democratizing Stream Processing with Apache Kafka® and KSQL - Part 2

    by Robin Moffatt Follow 2 Followers on  Sep 07, 2018

    In this article, author Robin Moffatt shows how to use Apache Kafka and KSQL to build data integration and processing applications with the help of an e-commerce sample application. Three use cases discussed: customer operations, operational dashboard, and ad-hoc analytics.

  • Architecture & Design Follow 2398 Followers

    A Critique of Resizable Hash Tables: Riak Core & Random Slicing

    by Scott Lystig Fritchie Follow 0 Followers on  Aug 26, 2018

    This fall, Wallaroo Labs will be releasing a large new feature set to our distributed data stream processing framework, Wallaroo. One of the new features requires a size-adjustable, distributed data structure to support growing & shrinking of compute clusters. It might be a good idea to use a distributed hash table to support the new feature, but what distributed hash algorithm should we choose?

  • AI, ML & Data Engineering Follow 990 Followers

    How to Choose a Stream Processor for Your App

    by Miyuru Dayarathna Follow 0 Followers , Srinath Perera Follow 2 Followers on  Aug 21, 2018 2

    Stream Processors are software platforms that enable users to respond to incoming data streams faster compared to traditional batch data processing. In this article, the authors discuss the stream processor reference architecture, key features required by most streaming applications and optional features that can be selected based on specific use cases.

AI, ML & Data Engineering Follow 990 Followers

Democratizing Stream Processing with Apache Kafka and KSQL - Part 1

Posted by Michael Noll Follow 0 Followers on  Jun 15, 2018

In this article, author discusses the stream processing with KSQL, the streaming SQL engine for Apache Kafka. Topics covered include challenges of stateful stream processing & how KSQL addresses them. 1

Followers

Virtual Panel: Succeeding with Event Sourcing

Posted by Richard Seroter Follow 8 Followers on  Feb 15, 2018

Why should you use event sourcing as a data storage and retrieval technique? What are the implications? When should you use platforms versus frameworks? InfoQ interviewed two experts to learn more.

AI, ML & Data Engineering Follow 990 Followers

Migrating Batch ETL to Stream Processing: A Netflix Case Study with Kafka and Flink

Posted by Daniel Bryant Follow 760 Followers on  Feb 08, 2018

At QCon NY, Shriya Arora presented “Personalising Netflix with Streaming Datasets” and discussed a migration of a data processing job from batch-style ETL to stream processing using Apache Flink.

Architecture & Design Follow 2398 Followers

Exploring the Fundamentals of Stream Processing with the Dataflow Model and Apache Beam

Posted by Daniel Bryant Follow 760 Followers on  Jan 30, 2018

At QCon SF 2016, Frances Perry and Tyler Akidau presented “Fundamentals of Stream Processing with Apache Beam”, and discussed Google's Dataflow model and associated implementation of Apache Beam.

Architecture & Design Follow 2398 Followers

Is Batch ETL Dead, and is Apache Kafka the Future of Data Processing?

Posted by Daniel Bryant Follow 760 Followers on  Jan 22, 2018

At QCon San Francisco 2016, Neha Narkhede presented “ETL is Dead; Long Live Streams”, and discussed the changing landscape of enterprise data processing. 5

Architecture & Design Follow 2398 Followers

Events, Flows and Long-Running Services: A Modern Approach to Workflow Automation

Posted by Bernd Rücker Follow 10 Followers , Martin Schimak Follow 10 Followers on  Dec 21, 2017

Although domain events can decrease coupling within a microservice architecture, we must avoid the mistakes of SOA: no centralised control, and workflow engines must be less painful to use and operate 7

Development Follow 684 Followers

Key Takeaway Points and Lessons Learned from QCon San Francisco 2017

Posted by Abel Avram Follow 11 Followers on  Dec 14, 2017

The eleventh annual QCon San Francisco was the biggest yet, bringing together over 1,800 team leads, architects, project managers, and engineering directors. 1

Architecture & Design Follow 2398 Followers

Know the Flow! Microservices and Event Choreographies

Posted by Bernd Rücker Follow 10 Followers , Martin Schimak Follow 10 Followers on  Jun 23, 2017

This article explores ways to implement services which are long running and stretch across the boundary of individual microservices using event based architectures 6

Mobile Follow 175 Followers

Processing Streaming Human Trajectories with WSO2 CEP

Posted by Miyuru Dayarathna Follow 0 Followers , Ramindu De Silva Follow 0 Followers on  Feb 27, 2017

Extracting useful information from inaccurate data stream, such as human trajectories, is a key issue in IoT applications. This problem can be successfully tackled with Kalman filters.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT