Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ


Choose your language

InfoQ Homepage Presentations Streaming for Personalization Datasets at Netflix

Streaming for Personalization Datasets at Netflix



Shriya Arora talks about the experiences Netflix’s Personalization Data team had in stream processing unbounded datasets and provides guidance on how to determine whether a streaming solution is a right fit for our problem. She compares microbatch vs event-based approaches with Apache Spark and Apache Flink and discusses the impact moving to stream processing had on the team, the challenges faced.


Shriya Arora is a senior data engineer at Netflix.

About the conference

Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Jul 26, 2017