Elliot Chow discusses the data pipeline that they built to process Netflix user activities in real time for the Trending Now row. He shares their experiences with developing, monitoring, and producing a system that uses Kafka, Spark Streaming, and Cassandra.
Elliot Chow is a software engineer at Netflix on the Personalization Infrastructure team. Currently, he builds big data systems using a variety of technologies including Scala, Spark (Streaming), Kafka, and Cassandra. He previously worked at eBay and Apple.
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.