InfoQ Homepage Event Driven Architecture Content on InfoQ
-
Write Directly from Cloud Pub/Sub to BigQuery with BigQuery Subscription
Recently Google introduced a new type of Pub/Sub subscription called a “BigQuery subscription,” allowing to write directly from Cloud Pub/Sub to BigQuery. The company claims that this new extract, load, and transform (ELT) path will be able to simplify event-driven architectures.
-
Fitting Presto to Large-Scale Apache Kafka at Uber
The need for ad-hoc real-time data analysis has been growing at Uber. They run a large Apache Kafka deployment and need to analyse data going through the many workflows it supports. Solutions like stream processing and OLAP datastores were deemed unsuitable. An article was published recently detailing why Uber chose Presto for this purpose and what it had to do to make it performant at scale.
-
Amazon Rekognition Introduces Streaming Video Events
AWS recently announced the general availability of Streaming Video Events, a new feature of Amazon Rekognition to provide real-time alerts on live video streams.
-
Kalix: Build Serverless Cloud-Native Business-Critical Applications with No Databases
Lightbend recently launched Kalix, a new PaaS offering for building cloud-native, business-critical applications using any programming language with no databases. Kalix is a unified application layer that pulls together the necessary pieces for writing software and abstracts their implementation details. Lighbend intends for it to provide developers with an innovative NoOps developer experience.
-
Netflix Studio Search: Using Elasticsearch and Apache Flink to Index Federated GraphQL Data
Netflix engineers recently published how they built Studio Search, using Apache Kafka streams, an Apache Flink-based Data Mesh process, and Elasticsearch to manage the index. They designed the platform to take a portion of Netflix's federated GraphQL graph and make it searchable. Today, Studio Search powers a significant portion of the user experience for many applications within the organisation.
-
AWS Increases the Availability and Reliability of Amazon EventBridge with Global Endpoints
Recently, AWS introduced a new capability called global endpoints for its serverless event bus service Amazon EventBridge to improve availability and reliability.
-
Fauna Transactional Database Introduces Event Streaming
Fauna, the company behind the Fauna transactional database, recently announced the general availability of event streaming, a push-based stream that sends changes at both the document and collection levels to subscribed clients.
-
Quine Aims to Simplify Event Processing on Data in Motion
Developed at thatDot, Quine is an open source streaming graph solution aimed at high-volume event processing. Quine combines graph data and streaming technologies to enable the creation of real-time, complex event processing workflows at scale, says thatDot.
-
Google Updates its Eventarc Service with New UI, Event Destination, and Storage Trigger
Recently, Google announced several new features for its eventing platform Eventarc. The new features are a new UI, Cloud Run for Anthos services as an event destination, and a generally available (GA) Storage Cloud trigger.
-
Airbnb Streamlines the Development Process with a Unified Architecture for Collaborative Hosting
Airbnb recently detailed how it designed and built a unified architecture for collaborative hosting. This architecture streamlines the development process of new products, as engineers only need to know about one central framework that will cover all hosting use cases. This framework encapsulates the specific types of collaborative hosting, freeing the engineers from the need to worry about them.
-
AWS Launches Amazon Kinesis Data Streams On-Demand
Amazon Kinesis Data Streams is a fully-managed, serverless service on AWS for real-time processing of streamed data at a massive scale. Recently, the company released a new capacity mode On-demand for the service, which eliminates capacity provisioning and management for streaming workloads.
-
AWS Introduces Amazon S3 Event Notifications with Amazon EventBridge
During the annual re:Invent, AWS introduced Amazon S3 Event Notifications for its serverless event bus service Amazon EventBridge. With S3 notifications, developers can leverage a more reliable and faster “directly wired” model.
-
AWS Step Functions Gains Integrations with over 200 Additional Services
Amazon Web Services (AWS) recently announced that AWS Step Functions supports over 200 AWS services via an AWS SDK integration, thereby expanding the number of supported API actions from 46 to over 9,000. The new integration type can support most existing and future services and API actions going forward.
-
Real-Time Exactly-Once Event Processing at Uber with Apache Flink, Kafka, and Pinot
Uber faced some challenges after introducing ads on UberEats. The events they generated had to be processed quickly, reliably and accurately. These requirements were fulfilled by a system based on Apache Flink, Kafka, and Pinot that can process streams of ad events in real-time with exactly-once semantics. An article describing its architecture was published recently in the Uber Engineering blog.
-
TriggerMesh Cloud Native Integration Platform Released as Open Source
Recently TriggerMesh, a cloud native integration platform provider, announced that their Cloud Native Integration Platform is now open source and available under the Apache Software License 2.0. It allows cloud operators and DevOps practitioners to freely deploy integrations as code.
CONTENT IN THIS BOX PROVIDED BY OUR SPONSOR
Resources
Camunda Platform 8: The Universal Process Orchestrator
Improve your productivity and collaboration with unparalleled speed, scale, and resilience. Start your free trial now.
Decoding Microservices: Best Practices Handbook for Developers
Don't let monolithic architecture hold you back. Learn 7 best practices for implementing microservices to design, build, and scale your business processes. Download now.
Camunda Platform 8: Try free now.
Business users and developers use Camunda 8 to collaborate, model, and automate end-to-end processes that run with speed, scale, and resiliency. Try Free.
