You are now in FULL VIEW

Cloud-Native and Scalable Kafka Architecture
Recorded at:

| by Allen Wang Follow 0 Followers on Apr 12, 2018 | NOTICE: The next QCon is in London, Mar 4 - 6, 2019. Join us!

Allen Wang talks about how Netflix addresses the issues of stability and scalability in a cloud environment by having many smaller and mostly immutable Kafka clusters with limited state changes. He proves the merit of this architecture in mathematical terms and illustrates how this architecture and additional tooling helps to improve availability, scale and failover.


Allen Wang is currently with Netflix Real-time Data Infrastructure team where he made significant contribution to Kafka and data infrastructure in AWS. He is a contributor to both Apache Kafka and NetflixOSS and the author of Kafka's rack-aware partition assignment.

Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.