InfoQ Homepage Real-Time Data Content on InfoQ
News
RSS Feed-
How HubSpot Uses Apache Kafka Swimlanes for Timely Processing of Workflow Actions
HubSpot adopted routing messages over multiple Kafka topics (called swimlanes) for the same producer to avoid the build-up in the consumer group lag and prioritize the processing of real-time traffic. Using a combination of automatic and manual detection of traffic spikes, the company ensures the majority of customers’s workflows execute without delays.
-
Microsoft Introduces Public Preview of Socket.IO Support on Azure Web PubSub
Microsoft recently added support for Socket.IO on Azure in public preview, allowing developers to leverage a fully-managed cloud solution through Web PubSub for Socket.IO.
-
Apache Druid 25.0 Delivers Multi-Stage Query Engine and Kubernetes Task Management
Apache Druid is a high-performance real-time datastore and its latest release, version 25.0, provides many improvements and enhancements. The main new features are: the multi-stage query (MSQ) task engine used for SQL-based ingestion is now production ready, and Kubernetes can be used to launch and manage tasks eliminating the need for middle managers...
-
Grafana Releases New Frontend Observability SDK and Backend Profiling Database
Grafana has announced two new additions to its suite of observability and monitoring tooling. Grafana Faro is an open-source web SDK for real user monitoring (RUM) of browser frontend applications. Grafana Phlare is an open-source backend database for storing and querying profiling data. A new flame graph panel is available to facilitate visualizing and interpreting the collected profile data.
-
Uber Freight Near-Real-Time Analytics Architecture
Uber Freight is the Uber platform dedicated to connecting shippers with carriers. Providing reliable service to shippers is crucial for Uber Freight. This is why the Carrier Scorecard was developed, with several metrics including on-time pickup/delivery, tracking automation, and late cancellations.
-
Microsoft Announces Preview Service for Building Real-Time Web Applications Called Azure Web PubSub
Recently Microsoft announced a preview of Azure Web PubSub, a new service for building real-time web applications. Azure Web PubSub is a fully-managed service that supports native and serverless WebSockets.
-
Hortonworks Addresses the IoAT with DataFlow Based on NiFi
Hortonworks has quietly made available the DataFlow platform which is based on Apache NiFi and attempts to solve the processing needs of the IoAT.
-
Twitter Has Replaced Storm with Heron
Twitter has replaced Storm with Heron which provides up to 14 times more throughput and up to 10 times less latency on a word count topology, and helped them reduce the needed hardware to a third.
-
Streaming Big Data With Amazon Kinesis
Amazon recently announced Kinesis, a service that allows developers to stream large amounts of data from different sources and process it. The service is currently in limited preview.