InfoQ Homepage Storage Content on InfoQ
-
Airbnb’s Mussel V2: Next-Gen Key Value Storage to Unify Streaming and Bulk Ingestion
Airbnb’s engineering team re-architected its internal key-value storage system, Mussel, to unify streaming and bulk ingestion while simplifying operations, achieving over 100,000 writes per second and sub-25ms read latencies on 100-terabyte tables, while leveraging Kubernetes, Kafka, and a NewSQL backend to improve scalability, reliability, and operational efficiency across its internal services.
-
Uber Achieves 150M Reads per Second with CacheFront Improvements
Uber has updated its CacheFront architecture to handle over 150 million reads per second. The new design improves consistency and reduces stale reads by integrating Flux for MySQL binlog tailing, enhancing the storage engine, and introducing Cache Inspector for monitoring and optimization.
-
Microsoft Azure Storage Discovery Enters Preview with Enhanced Blob Storage Analytics
Azure Storage Discovery is a service that offers a comprehensive overview of your blob storage ecosystem. Leverage advanced insights for cost optimization and security in real-time, using natural language with Azure Copilot. Quickly analyze data trends, detect outliers, and access 18 months of historical data, all in one intuitive dashboard. Experience unparalleled visibility and efficiency.
-
Google Cloud Introduces Non-Disruptive Cloud Storage Bucket Relocation
Google Cloud's innovative Cloud Storage bucket relocation feature enables seamless, non-disruptive data migration across regions while preserving metadata and minimizing application downtime. Maintain governance, enhance lifecycle management, and leverage insights for optimized storage—all without altering access paths. Experience efficient, low-latency solutions tailored for your needs.
-
Microsoft Enhances Azure Elastic SAN with Auto Scale, Snapshot Support, and CRC Protection
Microsoft's Azure Elastic SAN, launched in early 2024, revolutionizes cloud block storage with unique autoscale capabilities, snapshot support, and CRC protection for enhanced data integrity. This fully managed solution simplifies storage management and optimizes costs, making it ideal for businesses seeking efficient, high-availability solutions in the cloud.
-
Cloud-Native Distributed Storage System CubeFS Graduates from CNCF
The Cloud Native Computing Foundation (CNCF) has announced that the open-source distributed storage system CubeFS has reached graduation status. CubeFS is a storage solution supporting multiple access protocols, including POSIX, HDFS, S3, and its own REST API. CubeFS key platform areas are big data, AI/LLM applications, container platforms, and databases.
-
Microsoft's Customer Managed Planned Failover Type for Azure Storage Available in Public Preview
Microsoft’s new customer-managed planned failover for Azure Storage enhances disaster recovery by enabling geo-redundancy without data loss or reconfiguration. This proactive solution supports business continuity during outages and large-scale disasters, aligning with competitive offerings from AWS and Google Cloud.
-
Improving Distributed System Data Integrity with Amazon S3 Conditional Writes
AWS recently announced support for conditional writing in Amazon S3, allowing users to check for the existence of an object before creating it. This feature helps prevent overwriting existing objects when uploading data, making it easier for applications to manage data.
-
Microsoft Expands Azure Data Box Capabilities for Enhanced Offline Data Migration
Microsoft recently announced several capabilities for its Azure Data Box, a service that has been available since 2019 and facilitates offline data migration to Azure. These new capabilities enhance data transfer speed, flexibility, and security, offering organizations more efficient ways to move large datasets to the cloud without relying solely on network bandwidth.
-
Google Cloud Introduces Hierarchical Namespace for Cloud Storage in Preview
Google Cloud has announced a significant update to its Cloud Storage services by introducing the Hierarchical Namespace (HNS). Now available in preview, this new feature allows users to organize their storage buckets in a hierarchical file system structure, enhancing performance, consistency, and manageability.
-
Amazon S3 Unauthorized Request Billing Issue: an Empty S3 Bucket Can Dramatically Increase the Costs
Maciej Pocwierz, a senior software engineer, recently revealed a significant issue—an empty S3 bucket can unexpectedly result in a substantial AWS bill. In his case, nearly 100,000,000 S3 PUT requests were executed within a single day, leading to a bill that was far from negligible.
-
Stateful Cloud Services at Neon Navigating Design Decisions and Trade-Offs: Q&A with John Spray
At QCon London, John Spray, a storage engineering lead @neon.tech, discussed the often-overlooked complexities of stateful cloud service design, using Neon Serverless Postgres as a case study. His session was part of the Cloud-Native Engineering track on the first day of the conference, and InfoQ carried out an interview.
-
Azure Elastic Storage Area Network Solution Generally Available in the Cloud
Microsoft recently announced the general availability (GA) of its iSCSI-based Azure Elastic SAN, a fully-managed and cloud-native storage area network (SAN) offering.
-
Amazon ECS Integration with Amazon EBS for Data Processing Workloads and Flexible Storage
AWS recently announced that Amazon Elastic Container Service (Amazon ECS) supports an integration with Amazon Elastic Block Store (Amazon EBS), which makes it easier for users to run a broader range of data processing workloads.
-
Google Launches Three New Cloud Storage Options: Cloud Storage FUSE, Parallelstore, NetApp Volumes
Google recently launched three new cloud storage options: Cloud Storage FUSE for Artificial Intelligence (AI) applications that require file system semantics, a parallel file system Parallelstore for demanding AI and HPC applications that use GPUs, and NetApp Volumes for enterprise applications running in the cloud.