InfoQ Homepage Presentations Real-Time Recommendations Using Spark Streaming
Real-Time Recommendations Using Spark Streaming
47:03
Summary
Elliot Chow discusses the data pipeline that they built to process Netflix user activities in real time for the Trending Now row. He shares their experiences with developing, monitoring, and producing a system that uses Kafka, Spark Streaming, and Cassandra.
Bio
Elliot Chow is a software engineer at Netflix on the Personalization Infrastructure team. Currently, he builds big data systems using a variety of technologies including Scala, Spark (Streaming), Kafka, and Cassandra. He previously worked at eBay and Apple.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.
Mar 30, 2017