Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ


Choose your language

InfoQ Homepage Presentations Real-Time Recommendations Using Spark Streaming

Real-Time Recommendations Using Spark Streaming



Elliot Chow discusses the data pipeline that they built to process Netflix user activities in real time for the Trending Now row. He shares their experiences with developing, monitoring, and producing a system that uses Kafka, Spark Streaming, and Cassandra.


Elliot Chow is a software engineer at Netflix on the Personalization Infrastructure team. Currently, he builds big data systems using a variety of technologies including Scala, Spark (Streaming), Kafka, and Cassandra. He previously worked at eBay and Apple.

About the conference

Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Mar 30, 2017