InfoQ Homepage Streaming Content on InfoQ
-
Confluent Ships Stream Designer Democratizing Data Streams
Confluent recently released Stream Designer, a visual interface that lets developers quickly build and deploy streaming data pipelines.
-
Write Directly from Cloud Pub/Sub to BigQuery with BigQuery Subscription
Recently Google introduced a new type of Pub/Sub subscription called a “BigQuery subscription,” allowing to write directly from Cloud Pub/Sub to BigQuery. The company claims that this new extract, load, and transform (ELT) path will be able to simplify event-driven architectures.
-
Fitting Presto to Large-Scale Apache Kafka at Uber
The need for ad-hoc real-time data analysis has been growing at Uber. They run a large Apache Kafka deployment and need to analyse data going through the many workflows it supports. Solutions like stream processing and OLAP datastores were deemed unsuitable. An article was published recently detailing why Uber chose Presto for this purpose and what it had to do to make it performant at scale.
-
Amazon Rekognition Introduces Streaming Video Events
AWS recently announced the general availability of Streaming Video Events, a new feature of Amazon Rekognition to provide real-time alerts on live video streams.
-
Quine Aims to Simplify Event Processing on Data in Motion
Developed at thatDot, Quine is an open source streaming graph solution aimed at high-volume event processing. Quine combines graph data and streaming technologies to enable the creation of real-time, complex event processing workflows at scale, says thatDot.
-
Hazelcast Announces a New Unified Platform with Version 5.0
Hazelcast, the distributed computation and storage platform, has announced the release of the Hazelcast Platform version 5.0. This new platform unifies the existing products Hazelcast IMDG and Hazelcast Jet. InfoQ spoke about this new release with John DesJardins, CTO at Hazelcast.
-
AWS Launches Amazon Kinesis Data Streams On-Demand
Amazon Kinesis Data Streams is a fully-managed, serverless service on AWS for real-time processing of streamed data at a massive scale. Recently, the company released a new capacity mode On-demand for the service, which eliminates capacity provisioning and management for streaming workloads.
-
Real-Time Exactly-Once Event Processing at Uber with Apache Flink, Kafka, and Pinot
Uber faced some challenges after introducing ads on UberEats. The events they generated had to be processed quickly, reliably and accurately. These requirements were fulfilled by a system based on Apache Flink, Kafka, and Pinot that can process streams of ad events in real-time with exactly-once semantics. An article describing its architecture was published recently in the Uber Engineering blog.
-
Microsoft Announces Event Hubs Premium in Preview
Azure Event Hubs is Microsoft’s managed real-time event ingestion service designed to serve demanding big data streaming and event ingestion needs in the Cloud. Microsoft announced the public preview of Event Hubs Premium during the annual Build conference as a new product SKU tailor-made for high-end event streaming scenarios requiring elastic, superior performance with predictable latency.
-
Hazelcast Jet 4.4 Released - the Four-Year Anniversary Release as Seen by Scott McMahon
Hazelcast Jet recently celebrated its four-year anniversary with the release of version 4.4. Besides the normal bug fixes and performance enhancements, this new version ships with new features such as the unified file connector and the first beta version of the SQL interface. InfoQ spoke to Scott McMahon, technical director of field engineering at Hazelcast, about this new release.
-
Confluent Announces Strategic Alliance with Microsoft
Confluent, the company of the founders of Apache Kafka, recently announced a new strategic alliance between them and Microsoft to enable a more integrated experience between Confluent Cloud and the Azure platform.
-
AWS Introduces the Event Replay and Archive Capability in Its Eventbridge Service
Amazon EventBridge is a serverless event bus that delivers a stream of real-time data from event sources and routes that data to targets like AWS Lambda. Recently, AWS introduced an event replay and archive capability - providing developers a way to replay past events and extend their applications with new functionality.
-
Google Announces Eventarc in Preview
In a recent blog post, Google announced Eventarc, a new events functionality that allows customers to trigger Cloud Run from more than 60 Google Cloud sources. With Eventarc, customers can build event-driven applications and take care of event ingestion, delivery, security, authorization, observability, and error handling.
-
Amazon Kinesis Data Firehose Gains Delivery to HTTP Endpoints
Amazon Kinesis Data Firehose recently gained support to deliver streaming data to generic HTTP endpoints. This also enables additional AWS services as destinations via Amazon API Gateway's service integration. The new capability is complemented with dedicated integrations of additional third-party service providers like Datadog, MongoDB, and New Relic.
-
AWS Releases Amazon Timestream into General Availability
AWS recently announced the general availability of Amazon Timestream, a serverless purpose-built database that exposes time-series data through SQL. With Amazon Timestream, customers can save time and costs in managing the lifecycle of time series data by keeping recent data in memory and moving historical data to a cost-optimized storage tier based on user-defined policies.
SPONSORED BY
Live Webinar presented by DataStax |
Q&A moderated by InfoQ
Get the inside scoop on how Cassandra 4.1 adds exciting new features for operators & improves the security posture, without compromising the stability achieved in 4.0. Get some insights about projects actually in progress to make Cassandra more easy to use (Stargate) but also to deploy (K8ssandra).