BT

New Early adopter or innovator? InfoQ has been working on some new features for you. Learn more

Older rss
47:47

Stream Processing & Analytics with Flink @Uber

Posted by Danny Yuan  on  Mar 25, 2017 Posted by Danny Yuan  on  Mar 25, 2017

Danny Yuan discusses how Uber builds its next generation of stream processing system to support real-time analytics as well as complex event processing.

39:21

Demistifying DynamoDB Streams

Posted by Akshat Vig  on  Mar 25, 2017 Posted by Akshat Vig Khawaja Shams  on  Mar 25, 2017

Akshat Vig and Khawaja Shams discuss DynamoDB Streams and what it takes to build an ordered, highly available, durable, performant, and scalable replicated log stream.

39:00

ETL Is Dead, Long Live Streams

Posted by Neha Narkhede  on  Dec 06, 2016 1 Posted by Neha Narkhede  on  Dec 06, 2016 1

Neha Narkhede shares the experience at LinkedIn moving from ETL to real-time streams, the challenges of scaling Kafka to hundreds of billions of events/day, supporting thousands of engineers, etc.

54:56

Server-Less Design Patterns for the Enterprise with AWS Lambda

Posted by Tim Wagner  on  Jul 08, 2016 Posted by Tim Wagner  on  Jul 08, 2016

Tim Wagner defines server-less computing, examines the key trends and innovative ideas behind the technology, and looks at design patterns for big data, event processing, and mobile using AWS Lambda.

50:46

Large-Scale Stream Processing with Apache Kafka

Posted by Neha Narkhede  on  Jul 03, 2016 Posted by Neha Narkhede  on  Jul 03, 2016

Neha Narkhede explains how Apache Kafka was designed to support capturing and processing distributed data streams by building up the basic primitives needed for a stream processing system.

48:25

Staying in Sync: from Transactions to Streams

Posted by Martin Kleppmann  on  May 20, 2016 Posted by Martin Kleppmann  on  May 20, 2016

Martin Kleppmann explores using event streams and Kafka for keeping data in sync across heterogeneous systems, and compares this approach to distributed transactions.

40:32

Netflix Keystone - How We Built a 700B/day Stream Processing Cloud Platform in a Year

Posted by Peter Bakas  on  May 19, 2016 Posted by Peter Bakas  on  May 19, 2016

Peter Bakas presents in detail how Netflix has used Kafka, Samza, Docker, and Linux to implement a multi-tenant pipeline processing 700B events/day in the Amazon AWS cloud.

39:53

Connecting Stream Processors to Databases

Posted by Gian Merlino  on  Apr 03, 2016 Posted by Gian Merlino  on  Apr 03, 2016

Gian Merlino discusses stream processors and a common use case - keeping databases up to date-, the challenges they present, with examples from Kafka, Storm, Samza, Druid, and others.

48:11

Building Highly-resilient Systems at Pinterest

Posted by Yongsheng Wu  on  Feb 27, 2016 Posted by Yongsheng Wu  on  Feb 27, 2016

Yongsheng Wu talks about how to build highly-resilient systems at scale. Wu presents also failure cases that prompted engineers at Pinterest to build such systems, and how they test these systems.

48:32

Demystifying Stream Processing with Apache Kafka

Posted by Neha Narkhede  on  Dec 25, 2015 Posted by Neha Narkhede  on  Dec 25, 2015

Neha Narkhede describes Apache Kafka and Samza: scalability and parallelism through data partitioning, fault tolerance, order guarantees, stateful processing, and stream processing primitives.

01:29:08

Stream Processing at Scale with Spring XD and Kafka

Posted by Marius Bogoevici  on  Dec 24, 2015 Posted by Marius Bogoevici  on  Dec 24, 2015

Marius Bogoevici demoes how to unleash the power of Kafka with Spring XD, by building a highly scalable data pipeline with RxJava and Kafka, using Spring XD as a platform.

42:23

Stream Processing in Uber

Posted by Danny Yuan  on  Dec 04, 2015 Posted by Danny Yuan  on  Dec 04, 2015

Danny Yuan discusses how Uber uses stream processing to solve a wide range of problems, including real-time aggregation and prediction on geospatial time series, and much more.

BT