InfoQ Homepage Sharding Content on InfoQ
News
RSS Feed-
Airbnb Adds Adaptive Traffic Control to Manage Key Value Store Spikes
Airbnb upgraded Mussel, its multi-tenant key-value store, replacing static per-client rate limits with an adaptive, resource-aware traffic control system. The redesign ensures resilience during traffic spikes, protects critical workflows, and maintains fair usage across thousands of tenants while scaling efficiently.
-
Datadog Launches Monocle, a Unified Rust-Powered Real-Time Metrics Engine
Datadog has launched Monocle, a new real-time time series storage engine written in Rust. The system unifies the company’s metrics storage infrastructure, delivering higher ingestion throughput and lower query latency while reducing operational complexity. Monocle replaces several generations of storage backends, addressing concurrency challenges and scaling limits that accumulated over time.
-
Instacart Consolidates Search Infrastructure on PostgreSQL, Phasing out Elasticsearch
Instacart has redesigned its search infrastructure by replacing Elasticsearch with PostgreSQL, combining lexical and embedding-based retrieval in a single database engine. The change was driven by the cost and complexity of maintaining separate systems for search and transactional workloads. The company aimed to simplify operations, reduce overhead, and improve precision in search results.
-
Atlassian's 4 Million PostgreSQL Database Migration: When Standard Cloud Strategies Fail
Atlassian recently migrated 4 million Jira databases to Amazon Aurora, intending to reduce costs and improve the reliability of its Jira Cloud platform. Due to the large number of files involved and the constraints of managed services, the team developed a custom tool to orchestrate the process, as traditional cloud migration strategies were not viable.
-
Aurora Limitless: AWS Introduces New PostgreSQL Database with Automated Horizontal Scaling
AWS has announced the general availability of Amazon Aurora PostgreSQL Limitless Database, a relational database designed to provide automated horizontal scaling. This new option can handle millions of write transactions per second and manage petabytes of data, all within a single database environment.
-
MongoDB 8.0 Now Available with Performance Gains and Enhanced Sharding
MongoDB has announced the general availability of MongoDB 8.0, introducing significant performance enhancements and new features. Highlights include embedded sharding configuration servers, expanded support for queryable encryption, and the capability to move collections across shards without requiring a shard key.
-
Automated Horizontal Scaling with Amazon Aurora Limitless Database
AWS recently announced the preview of Amazon Aurora Limitless Database, a new capability supporting automated horizontal scaling to process millions of write transactions per second and manage petabytes of data in a single Aurora database.
-
AWS Announces GA of DocumentDB Elastic Clusters
At the recent re:Invent conference, AWS announced the general availability of DocumentDB Elastic Clusters, a service that manages the elasticity and sharding for MongoDB workloads.
-
Windows Azure Gets Node.js, SQL Azure Federation, Increased DB Limits
Windows Azure team announced major updates including support for Node.js, better scalability for SQL Azure through Federation and higher individual DB Size limits (upto 150 GB), a limited preview for Hadoop and more.