InfoQ Homepage Asynchronous Architecture Content on InfoQ
-
Dropbox’s Asynchronous Platform Evolution: from Challenges to a Unified Messaging System Model
Dropbox, a file sharing cloud platform, recently discussed their Messaging System Model (MSM) that supports diverse use cases and handles over 30 million tasks per minute.
-
Queue Support for Apache Kafka: KIP-932 and KMQ from SoftwareMill
The Apache Kafka community is actively working on enabling queue-like use cases for a popular messaging platform as part of the ongoing KIP-932 (Kafka Improvement Proposal). The proposal introduces a share group abstraction for cooperative message consumption. Meanwhile, SoftwareMill created an alternative solution that can work with the existing consumer group abstraction.
-
QCon London: How Duolingo Sent 4 Million Push Notifications in 6 Seconds During the Super Bowl Break
As part of the Super Bowl marketing campaign, Duolingo sent out 4 million mobile push notifications when the company’s five-second ad aired during the commercial break. At QCon London, Doulingo’s engineers presented the asynchronous AWS architecture responsible for broadcasting messages to millions of users across seven US cities.
-
Async Ops and Scalable Keyspaces Make Threads Go Viral
Meta's Engineering team has published a post explaining how they built the infrastructure for Threads, their new online social media and networking service. The decision to launch was abrupt, with the infrastructure teams having just two days' notice. However, the teams were confident in Meta's infrastructure's maturity and past performance to effectively support the app's rapid growth.
-
Pinterest Revamps Its Asynchronous Computing Platform with Kubernetes and Apache Helix
Pinterest created the next-generation asynchronous computing platform, Pacer, to replace the older solution, Pinlater, which the company outgrew, resulting in scalability and reliability challenges. The new architecture leverages Kubernetes for scheduling job-execution workers and Apache Helix for cluster management.
-
Applying Test-Driven Development in the Cloud
In the cloud, application development can be treated end-to-end with its accompanying infrastructure. This makes it possible to use test-driven development (TDD) and refactoring on the full application, which can bring down maintenance costs.
-
New CloudWatch Metrics for AWS Lambda Asynchronous Invocations
AWS recently added three new Amazon CloudWatch metrics for AWS Lambda: AsyncEventsReceived, AsyncEventAge, and AsyncEventsDropped, to monitor the performance of asynchronous event processing.
-
Kotlin Asynchronous Framework, Ktor 2.0, Released with New Plugins Feature
Ktor 2.0, the Kotlin framework to create asynchronous client and server applications, has been released with new features and breaking changes.
-
API Architecture Track Recap from QCon Plus
The API Architecture track at QCon Plus featured six speakers and panelists discussing topics relevant to software engineers and architects who design, build, and maintain APIs. The track covered broad concepts such as extensibility and API lifecycles, and featured a showdown between REST, GraphQL, and gRPC to determine the best technology to use when building an API.
-
Email Classification at Slack: Designing an Eventually Consistent Custom Classifier
Slack recently published the details of how it built an email address classification engine that can determine if an email address is internal or external. Slack engineers utilized an eventually consistent near real-time representation of the data in its system and implemented a drift detection mechanism to fix erroneous data, keeping the engine's operation in order.
-
eBay Adopts AsyncAPI for Asynchronous API Contracts
eBay recently announced that it adopted AsyncAPI for its external asynchronous API contracts. In March 2021, eBay launched its first AsyncAPI-based contracts for its new business event notification capabilities.
-
The Linux Foundation Announces Hosting of AsyncAPI
The Linux Foundation announced today that it would host the AsyncAPI Initiative. It will provide a forum where individuals and organizations can advance AsyncAPI and nurture collaboration in a neutral platform that can support the growth that AsyncAPI is experiencing.
-
AsyncAPI and Postman Partner to Bring New Tooling to Asynchronous APIs
AsyncAPI and Postman announced a partnership to support the AsyncAPI specification on the Postman platform. In their respective announcements, they detail how this partnership allows to boost the development of Asynchronous APIs. This will be done by building better tools to help engineers create and maintain Asynchronous APIs while using their favorite programming languages and frameworks.
-
How Dropbox Created a Distributed Async Task Framework at Scale
Engineers at Dropbox designed a distributed async task framework (ATF) that can handle tens of thousands of async tasks scheduled per second. ATF's main feature is its ability to enable developers to define callbacks and schedule tasks that execute against these pre-defined callbacks.
-
Smart APIs Require Reactive Business Processes and Technology - Bernd Ruecker at QCon London
Implementing smart APIs, with circuit breakers, async communication, and reactive services, requires changes to business processes, not just buzzword technology. At QCon London, Bernd Ruecker talked about the challenges and tradeoffs to consider when moving beyond simple, request/reply APIs.