InfoQ Homepage Apache Kafka Content on InfoQ
-
Co-Designing Raft + Thread-per-Core Execution Model for the Kafka-API
Alex Gallego discusses the lessons learned building a new storage engine from scratch with no virtual memory, no page cache, with purpose-built read-ahead and write-behind strategies.
/presentations/raft-kafka-api/en/mediumimage/Alex-Gallego-m-1637914189671.jpg)
-
Building and Scaling a Control Plane for 1000s of Kafka Clusters
Gwen Shapira and Vivek Sharma discuss some architectural highlights of building, evolving and scaling a control plane for thousands of Kafka clusters, and some challenges encountered.
/presentations/kafka-clusters-control-plane/en/mediumimage/Vivbig-1636122905463.jpg)
-
From Mainframe to Microservices with Pivotal Platform and Kafka: Bridging the Data Divide
Dmitry Milman and Ankur Kaneria showcase how Pivotal and Apache Kafka are leveraged within Express Scripts’ transformation from mainframe to a microservices-based ecosystem, ensuring data integrity.
/presentations/express-scripts-pivotal-kafka/en/mediumimage/Doibig-1594908860212.JPG)
-
Everything You Wanted to Know about Apache Kafka But Were Too Afraid to Ask!
Ricardo Ferreira explains what a streaming platform such as Apache Kafka is and some of the use cases and design patterns around its use.
/presentations/streaming-platform-kafka/en/mediumimage/Ricbig-1594572536079.JPG)
-
Kafka: A Modern Distributed System
Tim Berglund covers Kafka's distributed system fundamentals: the role of the Controller, the mechanics of leader election, and the role of Zookeeper today and in the future.
/presentations/kafka-controller-zookeeper/en/mediumimage/Timbig-1588674373241.JPG)
-
Monitoring and Tracing @Netflix Streaming Data Infrastructure
Allen Wang talks about the design and implementation details of the dev/ops tools used by Netflix and highlights the critical roles they play in operating their data infrastructure.
/presentations/netflix-streaming-data-infrastructure/en/mediumimage/Albig-1584722318863.JPG)
-
Streaming with Spring Cloud Stream and Apache Kafka
Oleg Zhurakousky and Soby Chacko explore how Spring Cloud Stream and Apache Kafka can streamline the process of developing event-driven microservices that use Apache Kafka.
/presentations/spring-cloud-stream-kafka-microservices/en/mediumimage/Doibig-1583367224904.JPG)
-
Kafka Needs No Keeper
Colin McCabe talks about the ongoing effort to replace the use of Zookeeper in Kafka: why they want to do it and how it will work.
/presentations/kafka-zookeeper/en/mediumimage/Colbig-1583280959599.JPG)
-
Practical Change Data Streaming Use Cases with Apache Kafka & Debezium
Gunnar Morling discusses practical matters, best practices for running Debezium in production on and off Kubernetes, and the many use cases enabled by Kafka Connect's single message transformations.
/presentations/data-streaming-kafka-debezium/en/mediumimage/Gunbig-1577917705997.JPG)
-
Apache Kafka Event-streaming Platform for .NET Developers
Viktor Gamov reviews Kafka -internal architecture, fault-tolerance, message durability- and how the Confluent .NET client offers a framework for computation over streaming data.
/presentations/kafka-confluent-net/en/mediumimage/Vikbig-1577486289658.JPG)
-
RabbitMQ and Kafka
Zoe Vance, Madhav Sathe discuss the architecture and design of RabbitMQ and Kafka, and how that impacts performance, scalability and app design.
/presentations/rabbitmq-kafka/en/mediumimage/Zoebig-1576765527216.JPG)
-
Building Reactive Pipelines: How to Go from Scalable Apps to (Ridiculously) Scalable Systems
Mark Heckler discusses and demoes reactive and highly scalable microservices built with Project Reactor using RabbitMQ, Apache Kafka, and Spring Cloud Stream.
/presentations/spring-reactor-microservices/en/mediumimage/Marbig-1576110270677.JPG)