Podcasts

Building a Reliable Kafka Data Processing Pipeline with Lily Mara

In this episode Thomas Betts talks to Lily Mara, engineering manager at OneSignal in San Mateo, California. She manages the infrastructure services team, which is responsible for in-house services used by other OneSignal engineering teams. They will discuss how to build a reliable Kafka data processing pipeline.

Colin McCabe Updates on Apache Kafka KRaft Mode

Today on the InfoQ Podcast, Wes Reisz speaks withColin McCabe about Apache Kafka’s KRaft mode. KRaft mode is the new operating mode of Apache Kafka released with 3.3.1 and is the new target architecture for Kafka metadata (the current roadmap will completely deprecate Zookeeper in Kafka in the 4.0 release). On the podcast, Wes and Colin discuss KRaft mode and what it means for the Kafka ecosystem.

Event Driven Architectures of Scale

Wes Reisz, Matthew Clark, Gwen Shapira, and Ian Thomas discuss the evolution of event-driven architectures over the decades, the advantages that EDA offers, and thoughts for the future.

Lucas Cavalcanti on Using Clojure, Microservices, Hexagonal Architecture and Public Cloud at Nubank

In this episode of the InfoQ podcast, Charles Humble talks to Lucas Cavalcanti about Nubank’s early architectural choices, including starting with Clojure and microservices. They discuss the challenges of using public cloud for financial services in Brazil, Nubank’s use of Alistair Cockburn's Hexagonal Architecture and immutable architecture, and lessons learnt as the startup scaled.

Removing the Dependency of Zookeeper on Kafka

Today on the InfoQ Podcast, Wes Reisz talks with Justin Gustafson and Colin McCabe, two of the engineers currently working on removing the dependency of ZooKeeper in Kafka. The three discuss why the team made this decision, what the ramifications are, and explore what both the near and future state will be with upgrading and operating Kafka.