InfoQ Homepage SQS Content on InfoQ
-
From Outages to Order: Netflix’s Approach to Database Resilience with WAL
Netflix uses a Write-Ahead Log (WAL) system to improve data platform resilience, addressing data loss, replication entropy, multi-partition failures, and corruption. WAL decouples producers and consumers, leverages SQS/Kafka with dead-letter queues, and supports delay queues, cross-region replication, and multi-table mutations for high-throughput, consistent, and recoverable database operations.
-
Amazon SQS Fair Queues: a New Approach to Multi-Tenant Resiliency
AWS's new Fair Queues for Amazon SQS revolutionize message handling in multi-tenant systems by mitigating the "noisy neighbor" issue. This feature ensures low message dwell times for quieter tenants without requiring code changes, enhancing both performance and fairness. Developers can effortlessly implement this capability and maintain consistent service quality across applications.
-
Grab Switches from SQS and Redis to Temporal for Its Subscription Platform
Grab based the new architecture for GrabUnlimited on Temporal. The company enhanced user experience and reduced production incidents by 80% for its subscription platform, which serves millions of users. The new architecture significantly improved robustness and scalability, addressing a range of issues with the previous solution.
-
No EC2 or Kubernetes Allowed: Insights from Building Serverless-Only Architecture at PostNL
PostNL shared insights and guidance from its transition from outsourced IT project delivery to an in-house product delivery capability. By embracing cloud-native technologies, with an emphasis on serverless services, the company achieved significant gains in productivity and market responsiveness while reducing operational costs.
-
Canva Opts for Amazon KDS over SNS+SQS to Save 85% with 25 Billion Events per Day
Canva evaluated different data massaging solutions for its Product Analytics Platform, including the combination of AWS SNS and SQS, MKS, and Amazon KDS, and eventually chose the latter, primarily based on its much lower costs. The company compared many aspects of these solutions, like performance, maintenance effort, and cost.
-
QCon London: How Duolingo Sent 4 Million Push Notifications in 6 Seconds During the Super Bowl Break
As part of the Super Bowl marketing campaign, Duolingo sent out 4 million mobile push notifications when the company’s five-second ad aired during the commercial break. At QCon London, Doulingo’s engineers presented the asynchronous AWS architecture responsible for broadcasting messages to millions of users across seven US cities.
-
New Amazon SQS Bindings Added to CoreWCF
Amazon delivered a new binding for CoreWCF, the open-source replacement for Windows Communication Foundation. The new binding supports the Amazon Simple Queue Service (SQS) in both server and client code. The new binding allows simple migration of legacy Microsoft MSMQ binding to an AWS cloud-based implementation.
-
Pfizer Uses Serverless Architecture on AWS to Scale Processing of Digital Biomarkers
Pfizer upgraded the serverless architecture for processing digital biomarker data at scale to make it more flexible and configurable. They created a framework that uses a file processing pipeline built with AWS Step Functions and other serverless services, as well as a custom Python package for data ingestion and processing.
-
Amazon SQS Supports Reprocessing Messages from Dead-Letter Queue
AWS recently announces support for dead-letter queue redrive in SQS using the AWS SDK or the Command Line Interface. The new capability allows developers to move unconsumed messages out of an existing dead-letter queue and back to their source queue.
-
AWS Lambda Now Supports Maximum Concurrency for SQS as Event Source
AWS Lambda now provides a way to control the maximum number of concurrent functions invoked by Amazon SQS as an event source. Setting the Maximum Concurrency, developers can determine the concurrency of the functions processing messages in individual SQS queues, simplifying the scalability of serverless applications.
-
Cloudflare Previews Globally Distributed Queues without Egress Fees
Cloudflare recently announced the private beta of Cloudflare Queues, a message queuing service that allows applications to send and receive messages using Cloudflare Workers. The new service provides at-least once message delivery, supports batching of messages, and does not charge bandwidth egress fees.
-
Atlassian Exceeds 99.9999% of Availability Using Sidecars and Highly Fault-Tolerant Design
Atlassian recently published how it exceeded 99.9999% of availability with its Tenant Context Service. Atlassian achieved this high availability by implementing highly-autonomous client sidecars, able to proactively shield themselves from complete AWS region failures. Sidecars query multiple services concurrently to accomplish this goal and ensure that requests are entirely isolated internally.
-
Dynein – an Asynchronous Background Job Service from Airbnb
At Airbnb, they move time consuming, resource intensive tasks over to asynchronous background jobs to improve scalability. The job scheduling system has become a very important component and they have therefore built Dynein, a distributed delayed job queueing service and scheduler. In a blog post, Andy Fang from Airbnb describes the background and challenges in designing and building the service.
-
Amazon Updates SQS to Support Amazon VPC Endpoints Using AWS PrivateLink
Amazon announced last month that its fully managed message queuing service Simple Queue Service (SQS) supports Virtual Private Cloud (VPC) Endpoints using AWS PrivateLink. Now customers can have with this update private access to SQS and not have to use public IPs and traverse the public internet.
-
Amazon Announces AWS Lambda Now Supports Simple Queue Service (SQS) as an Event Source
Amazon announced an update to their Simple Queue Service (SQS) – developers can now use SQS to trigger AWS Lambda Functions. Moreover, no longer are developers required to run a polling service or create an SQS to SNS mapping.