BT
Older rss
46:00
Architecture & Design Follow 2114 Followers

Drivetribe: A Social Network on Streams

Posted by Aris Koliopoulos  on  May 02, 2018 Posted by Aris Koliopoulos Follow 0 Followers  on  May 02, 2018

Aris Koliopoulos talks about how common problems in social media can be resolved with a healthy mix of stream processing and functional programming.

47:47
Architecture & Design Follow 2114 Followers

Stream Processing & Analytics with Flink @Uber

Posted by Danny Yuan  on  Mar 25, 2017 Posted by Danny Yuan Follow 3 Followers  on  Mar 25, 2017

Danny Yuan discusses how Uber builds its next generation of stream processing system to support real-time analytics as well as complex event processing.

39:21
Architecture & Design Follow 2114 Followers

Demistifying DynamoDB Streams

Posted by Akshat Vig  on  Mar 25, 2017 Posted by Akshat Vig Follow 0 Followers , Khawaja Shams Follow 0 Followers  on  Mar 25, 2017

Akshat Vig and Khawaja Shams discuss DynamoDB Streams and what it takes to build an ordered, highly available, durable, performant, and scalable replicated log stream.

39:00
AI, ML & Data Engineering Follow 870 Followers

ETL Is Dead, Long Live Streams

Posted by Neha Narkhede  on  Dec 06, 2016 1 Posted by Neha Narkhede Follow 2 Followers  on  Dec 06, 2016 1

Neha Narkhede shares the experience at LinkedIn moving from ETL to real-time streams, the challenges of scaling Kafka to hundreds of billions of events/day, supporting thousands of engineers, etc.

54:56
Architecture & Design Follow 2114 Followers

Server-Less Design Patterns for the Enterprise with AWS Lambda

Posted by Tim Wagner  on  Jul 08, 2016 Posted by Tim Wagner Follow 4 Followers  on  Jul 08, 2016

Tim Wagner defines server-less computing, examines the key trends and innovative ideas behind the technology, and looks at design patterns for big data, event processing, and mobile using AWS Lambda.

50:46
AI, ML & Data Engineering Follow 870 Followers

Large-Scale Stream Processing with Apache Kafka

Posted by Neha Narkhede  on  Jul 03, 2016 Posted by Neha Narkhede Follow 2 Followers  on  Jul 03, 2016

Neha Narkhede explains how Apache Kafka was designed to support capturing and processing distributed data streams by building up the basic primitives needed for a stream processing system.

48:25
AI, ML & Data Engineering Follow 870 Followers

Staying in Sync: from Transactions to Streams

Posted by Martin Kleppmann  on  May 20, 2016 Posted by Martin Kleppmann Follow 11 Followers  on  May 20, 2016

Martin Kleppmann explores using event streams and Kafka for keeping data in sync across heterogeneous systems, and compares this approach to distributed transactions.

40:32
AI, ML & Data Engineering Follow 870 Followers

Netflix Keystone - How We Built a 700B/day Stream Processing Cloud Platform in a Year

Posted by Peter Bakas  on  May 19, 2016 Posted by Peter Bakas Follow 0 Followers  on  May 19, 2016

Peter Bakas presents in detail how Netflix has used Kafka, Samza, Docker, and Linux to implement a multi-tenant pipeline processing 700B events/day in the Amazon AWS cloud.

39:53
AI, ML & Data Engineering Follow 870 Followers

Connecting Stream Processors to Databases

Posted by Gian Merlino  on  Apr 03, 2016 Posted by Gian Merlino Follow 0 Followers  on  Apr 03, 2016

Gian Merlino discusses stream processors and a common use case - keeping databases up to date-, the challenges they present, with examples from Kafka, Storm, Samza, Druid, and others.

48:11
Architecture & Design Follow 2114 Followers

Building Highly-resilient Systems at Pinterest

Posted by Yongsheng Wu  on  Feb 27, 2016 Posted by Yongsheng Wu Follow 0 Followers  on  Feb 27, 2016

Yongsheng Wu talks about how to build highly-resilient systems at scale. Wu presents also failure cases that prompted engineers at Pinterest to build such systems, and how they test these systems.

48:32
AI, ML & Data Engineering Follow 870 Followers

Demystifying Stream Processing with Apache Kafka

Posted by Neha Narkhede  on  Dec 25, 2015 Posted by Neha Narkhede Follow 2 Followers  on  Dec 25, 2015

Neha Narkhede describes Apache Kafka and Samza: scalability and parallelism through data partitioning, fault tolerance, order guarantees, stateful processing, and stream processing primitives.

01:29:08
Java Follow 938 Followers

Stream Processing at Scale with Spring XD and Kafka

Posted by Marius Bogoevici  on  Dec 24, 2015 Posted by Marius Bogoevici Follow 1 Followers  on  Dec 24, 2015

Marius Bogoevici demoes how to unleash the power of Kafka with Spring XD, by building a highly scalable data pipeline with RxJava and Kafka, using Spring XD as a platform.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT