InfoQ Homepage Event Stream Processing Content on InfoQ
-
Real-Time Exactly-Once Event Processing at Uber with Apache Flink, Kafka, and Pinot
Uber faced some challenges after introducing ads on UberEats. The events they generated had to be processed quickly, reliably and accurately. These requirements were fulfilled by a system based on Apache Flink, Kafka, and Pinot that can process streams of ad events in real-time with exactly-once semantics. An article describing its architecture was published recently in the Uber Engineering blog.
-
Microsoft Announces Event Hubs Premium in Preview
Azure Event Hubs is Microsoft’s managed real-time event ingestion service designed to serve demanding big data streaming and event ingestion needs in the Cloud. Microsoft announced the public preview of Event Hubs Premium during the annual Build conference as a new product SKU tailor-made for high-end event streaming scenarios requiring elastic, superior performance with predictable latency.
-
Hazelcast Jet 4.4 Released - the Four-Year Anniversary Release as Seen by Scott McMahon
Hazelcast Jet recently celebrated its four-year anniversary with the release of version 4.4. Besides the normal bug fixes and performance enhancements, this new version ships with new features such as the unified file connector and the first beta version of the SQL interface. InfoQ spoke to Scott McMahon, technical director of field engineering at Hazelcast, about this new release.
-
Confluent Announces Strategic Alliance with Microsoft
Confluent, the company of the founders of Apache Kafka, recently announced a new strategic alliance between them and Microsoft to enable a more integrated experience between Confluent Cloud and the Azure platform.
-
Google Announces Eventarc in Preview
In a recent blog post, Google announced Eventarc, a new events functionality that allows customers to trigger Cloud Run from more than 60 Google Cloud sources. With Eventarc, customers can build event-driven applications and take care of event ingestion, delivery, security, authorization, observability, and error handling.
-
Amazon Kinesis Data Firehose Gains Delivery to HTTP Endpoints
Amazon Kinesis Data Firehose recently gained support to deliver streaming data to generic HTTP endpoints. This also enables additional AWS services as destinations via Amazon API Gateway's service integration. The new capability is complemented with dedicated integrations of additional third-party service providers like Datadog, MongoDB, and New Relic.
-
AWS Releases Amazon Timestream into General Availability
AWS recently announced the general availability of Amazon Timestream, a serverless purpose-built database that exposes time-series data through SQL. With Amazon Timestream, customers can save time and costs in managing the lifecycle of time series data by keeping recent data in memory and moving historical data to a cost-optimized storage tier based on user-defined policies.
-
Infinite Storage & Retention for Apache Kafka in Confluent Cloud
Confluent, Inc. recently announced the Infinite Storage option for its standard and dedicated clusters. This offering is a part of the Project Metamorphosis initiative, which is focused on enabling Kafka with modern cloud properties. Organizations can have a centralized platform for all event data for real-time actioning and historical analysis with limitless storage and retention.
-
CamundaCon Live 2020: Highlights
Earlier this year, Camunda hosted CamundaCon, an online conference on process automation revolving around Camunda's open-source products. The conference featured multiple use-case sessions on process automation, virtual panels on automation and digital transformation, and technical sessions on microservices orchestration and integrating Camunda products with other technologies.
-
Amazon EventBridge Schema Registry Now Generally Available on AWS
Recently Amazon announced the general availability of the Schema Registry capability in the Amazon EventBridge service. With Amazon EventBridge Schema Registry, developers can store the event structure - or schema - in a shared central location and map those schemas to code for Java, Python, and Typescript, meaning that they can use events as objects in their code.
-
KSQL Now Available on Confluent Cloud
KSQL is the streaming SQL engine for Apache Kafka, and it is currently available as a fully-managed service on the Confluent Cloud Platform for all its customers on usage-based billing plans. In a recent blog post, Confluent announced the availability of Confluent Cloud KSQL.
-
Confluent Offers Apache Kafka as a Service on the Azure Marketplace
In a recent blog post, Confluent announced the general availability of Confluent Cloud on Microsoft Azure. Confluent Cloud is a fully managed Apache Kafka service that removes the burden of operationally managing Kafka for engineers.
-
Experience Using Event Streams, Kafka and the Confluent Platform at Deutsche Bahn
To provide trip information to their rail passengers, Deutsche Bahn (DB) has created the RI-Plattform (Passenger Information Application) based on Apache Kafka and Kafka Streams with a plan to feed all information channels through the system. In a blog post, Axel Löhn and Uwe Eisele describe the microservices based design, how they build and run the system, and their experience from production.
-
Change Data Capture Tool Debezium 1.0 Final Released
The open source change data capture (CDC) tool Debezium 1.0 Final was recently released with an event format clean-up, increased test coverage of databases, and 96 issues addressed. In a blog post Gunnar Morling describes Debezium's basic concepts and some common use cases, and details about both the current release and what to expect in future releases.
-
Confluent Offers Apache Kafka as a Service on the GCP Marketplace
In a recent blog post, Confluent announced the general availability of Confluent Cloud on the Google Cloud Platform (GCP) Marketplace. Confluent Cloud is a fully managed Apache Kafka service, which removes the burden of its users to manage Kafka themselves.