InfoQ Homepage Asynchronous Architecture Content on InfoQ
-
Pinterest Revamps Its Asynchronous Computing Platform with Kubernetes and Apache Helix
Pinterest created the next-generation asynchronous computing platform, Pacer, to replace the older solution, Pinlater, which the company outgrew, resulting in scalability and reliability challenges. The new architecture leverages Kubernetes for scheduling job-execution workers and Apache Helix for cluster management.
-
Applying Test-Driven Development in the Cloud
In the cloud, application development can be treated end-to-end with its accompanying infrastructure. This makes it possible to use test-driven development (TDD) and refactoring on the full application, which can bring down maintenance costs.
-
New CloudWatch Metrics for AWS Lambda Asynchronous Invocations
AWS recently added three new Amazon CloudWatch metrics for AWS Lambda: AsyncEventsReceived, AsyncEventAge, and AsyncEventsDropped, to monitor the performance of asynchronous event processing.
-
Kotlin Asynchronous Framework, Ktor 2.0, Released with New Plugins Feature
Ktor 2.0, the Kotlin framework to create asynchronous client and server applications, has been released with new features and breaking changes.
-
API Architecture Track Recap from QCon Plus
The API Architecture track at QCon Plus featured six speakers and panelists discussing topics relevant to software engineers and architects who design, build, and maintain APIs. The track covered broad concepts such as extensibility and API lifecycles, and featured a showdown between REST, GraphQL, and gRPC to determine the best technology to use when building an API.
-
Email Classification at Slack: Designing an Eventually Consistent Custom Classifier
Slack recently published the details of how it built an email address classification engine that can determine if an email address is internal or external. Slack engineers utilized an eventually consistent near real-time representation of the data in its system and implemented a drift detection mechanism to fix erroneous data, keeping the engine's operation in order.
-
eBay Adopts AsyncAPI for Asynchronous API Contracts
eBay recently announced that it adopted AsyncAPI for its external asynchronous API contracts. In March 2021, eBay launched its first AsyncAPI-based contracts for its new business event notification capabilities.
-
The Linux Foundation Announces Hosting of AsyncAPI
The Linux Foundation announced today that it would host the AsyncAPI Initiative. It will provide a forum where individuals and organizations can advance AsyncAPI and nurture collaboration in a neutral platform that can support the growth that AsyncAPI is experiencing.
-
AsyncAPI and Postman Partner to Bring New Tooling to Asynchronous APIs
AsyncAPI and Postman announced a partnership to support the AsyncAPI specification on the Postman platform. In their respective announcements, they detail how this partnership allows to boost the development of Asynchronous APIs. This will be done by building better tools to help engineers create and maintain Asynchronous APIs while using their favorite programming languages and frameworks.
-
How Dropbox Created a Distributed Async Task Framework at Scale
Engineers at Dropbox designed a distributed async task framework (ATF) that can handle tens of thousands of async tasks scheduled per second. ATF's main feature is its ability to enable developers to define callbacks and schedule tasks that execute against these pre-defined callbacks.
-
Smart APIs Require Reactive Business Processes and Technology - Bernd Ruecker at QCon London
Implementing smart APIs, with circuit breakers, async communication, and reactive services, requires changes to business processes, not just buzzword technology. At QCon London, Bernd Ruecker talked about the challenges and tradeoffs to consider when moving beyond simple, request/reply APIs.
-
Dynein – an Asynchronous Background Job Service from Airbnb
At Airbnb, they move time consuming, resource intensive tasks over to asynchronous background jobs to improve scalability. The job scheduling system has become a very important component and they have therefore built Dynein, a distributed delayed job queueing service and scheduler. In a blog post, Andy Fang from Airbnb describes the background and challenges in designing and building the service.
-
Sharing Experiences from a Microservices Journey
In our continued effort to showcase lessons learned by microservices practitioners, we look at an article Piotr Gankiewicz has recently written with his own tips and tricks. These include references to CQRS, asynchronous architectures, service discovery and how choosing the right database for each service is important.
-
Confluent Announces Kafka for the Enterprise with Multi-Datacenter Replication
Confluent Enterprise latest version supports multi-datacenter replication, automatic data balancing, and cloud migration capability. Confluent, provider of the Apache Kafka based streaming platform, announced last week the new features for Confluent Enterprise, to help build streaming data pipelines and develop stream processing applications.
-
Netflix Zuul Gets a Makeover to a Asynchronous and Non-Blocking Architecture
Rags Srinivas caught up with engineering manager at Netflix, Mikey Cohen, regarding their major re-architecture of their Zuul gateway for microservices. Cohen talks about the journey and walks through the motivation and challenges of this significant effort.