InfoQ Homepage Apache Kafka Content on InfoQ
-
License Changes for Confluent Platform Restricting Cloud Vendor Usage
Confluent has announced changes to the license for some components of their Confluent Platform, a streaming platform which provides capabilities to transport data, and tools to connect systems and data sources. The license changes specifically focus on restricting the usage of these components by SaaS providers.
-
Scaling Apache Kafka at Pinterest
Apache Kafka is used at Pinterest for transporting data for real time streaming applications, logging and visibility metrics for monitoring. Hosted on AWS, Pinterest’s Kafka installation uses the MirrorMaker and DoctorKafka tools for replication and high availability.
-
Amazon Announces Managed Streaming for Kafka in Public Preview
At the recent AWS re:Invent 2018 event, Amazon announced a new fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. This new service is called Amazon Managed Streaming for Kafka, Amazon MSK for short, and is now in public preview.
-
Microsoft Announces the General Availability of Azure Event Hubs for Apache Kafka
Recently, Microsoft announced the general availability of Azure Event Hubs for Apache Kafka. Customers will get the best of both worlds—the ecosystem and tools of Kafka, along with Azure’s security and global scale.
-
Q&A with Microsoft's Arindam Chatterjee Discussing Azure HDInsight 4.0
InfoQ caught up with Arindam Chatterjee, principal group manager at Microsoft, regarding the announcements about HDInsight at Microsoft Ignite.
-
Confluent Platform 5.0 Supports LDAP Authorization and MQTT Proxy for IoT Integration
Confluent Platform 5.0, the enterprise streaming platform built on Apache Kafka, supports LDAP authorization, Kafka topic inspection, and Confluent MQTT Proxy for Internet of Things (IoT) integration.
-
eBay Replatforming to Kubernetes, Envoy and Kafka: Intending to Open Source Hardware and Software
eBay has discussed how they are conducting a replatforming initiative across their entire technology stack, including building and releasing as open source both the hardware and software. Open source is fueling the software transformation of eBay’s infrastructure with cloud native technologies like Kubernetes, Envoy, MongoDB, Docker and Apache Kafka.
-
NATS Messaging System Gets Kafka-Like Log API via Liftbridge
Joining the hot event-driven technology space is Liftbridge, an open-source project that extends the NATS messaging system with a scalable, Kafka-like log API. InfoQ spoke to creator Tyler Treat to learn more about the project, and the changing nature of data integration.
-
Scaling Push Messaging for Millions of Devices @Netflix - Susheel Aroskar at QCon NY
Susheel Aroskar from Netflix's Engineering team spoke at the recent QCon New York 2018 Conference about Zuul Push, a scalable push notification service that asynchronously pushes data like personalized movie recommendations from cloud to devices.
-
Experiences from Building an Event-Sourced System with Kafka Streams
At the recent JEEConf conference in Kiev, Amitay Horwitz described how he and his team implemented an event-sourced invoice system, the challenges they experienced after running in production for 2 ½ years, and how they implemented a new design using Kafka Streams. The new design is still under assessment, but they do heavily use Kafka in production.
-
Microsoft Announces Azure Event Hubs for Kafka Ecosystems in Public Preview
During Build 2018, Microsoft announced it would support Kafka clients to integrate with Azure Event Hubs. The Microsoft engineering team responsible for Azure Event Hubs made a Kafka endpoint available for users of their service to stream event data into it.
-
Managing and Operating Kafka Clusters in Kubernetes
Nenad Bogojevic, platform solutions architect at Amadeus, spoke at KubeCon + CloudNativeCon North America 2017 Conference on how to run and manage Kafka clusters in Kubernetes environment. He talked about provisioning Kafka clusters and configuring them using Kubernetes custom resources or ConfigMaps.
-
Kevin Webber on Migrating Java to the Cloud
Kevin Webber spoke at Reactive Summit 2017 last month about migrating enterprise Java applications to the cloud by leveraging techniques like Event Storming, Domain Driven Design, and Cloud Native.
-
Apache Kafka Reaches 1.0
The Apache Software Foundation has announced Apache Kafka 1.0, adding an improved Streams API, enhanced metrics, improved tolerance for disk failures, general bug fixes, and more.
-
Confluent Releases KSQL, a Distributed Streaming SQL Engine for Apache Kafka
Confluent released KSQL: interactive, distributed streaming SQL engine for Apache Kafka. KSQL supports stream processing operations like aggregations, joins, windowing, and sessionization on topics in Apache Kafka. Confluent announced the open source streaming SQL engine at the recent Kafka Summit conference.