InfoQ Homepage Data Storage Content on InfoQ
-
Filecoin Aims to Use Blockchain to Make Decentralized Storage Resilient and Hard to Censor
Launched in 2017, Filecoin is an open-source decentralized storage network that uses blockchain to implement a cooperative digital storage and data retrieval solution. InfoQ has spoken with Filecoin software engineer Aayush Rajasekaran, who built Filecoin's Lotus implementation.
-
Cockroach Labs 2021 Cloud Report: GCP Outpaces Azure and AWS
Cockroach Labs recently released their annual cloud report identifying Google Cloud Platform as the best overall provider. The 2021 Cloud Report compares AWS, Azure, and GCP on benchmarks that reflect critical applications and workloads.
-
AWS Transfer Family Introduces Support for EFS
AWS has recently introduced support for Amazon EFS as a data store in the AWS Transfer Family, the managed service that handles SFTP, FTP and FTPS requests. The new option is intended to simplify the migration to the cloud of file transfer workloads.
-
Amazon S3 Now Delivers Strong Read-After-Write Consistency
To guarantee higher availability and better performances, S3 has for years relied on an eventual consistency model. During the first week of re:invent, AWS announced that S3 now supports strong read-after-write consistency.
-
AWS Announces New S3 Intelligent-Tiering Archive Access Tiers
S3 Intelligent-Tiering is a storage class, which AWS added to Amazon S3 for optimization of storage costs for its users. The company recently announced it would add two new archive access tiers designed for asynchronous access optimized for rare access at a very low cost: Archive Access tier and Deep Archive Access tier.
-
Rancher Labs Makes Longhorn Generally Available
Creators of Kubernetes management platform Rancher Labs have made Longhorn, a cloud-native block storage solution, generally available. Longhorn provides a vendor-neutral persistent storage solution that supports the development of stateful applications within Kubernetes. Longhorn is open source, distributed block storage built using microservices.
-
Amazon Updates AWS Snowball Edge with Faster Hardware, OpsHub GUI, IAM, and AWS Systems Manager
AWS Snowball is a part of the AWS Snow Family of edge computing and data transfer devices. Recently Amazon announced a few updates for Snowball Edge device option. It now has a graphical user interface with AWS OpsHub, 25% faster data transfer performance, and support for local Identity and Access Management (IAM), and AWS System Manager.
-
Microsoft Ships Preview of Cluster-Friendly Cloud Disks
Storage is one of the more mature services in the public cloud, but rarely supports traditional clustered systems. To attract those on-premises workloads, the Microsoft Azure team released a preview of Azure Shared Disks, a block storage option for attaching managed disks to multiple virtual machines.
-
Amazon Elastic File System New Features: IAM Authorization and Access Points
Amazon’s Elastic File System (EFS) Service (EFS) offers a simple, scalable, fully managed elastic NFS file system for use with AWS Cloud services and on-premises resources. Recently Amazon announced updates for this service by adding two new features, namely Identity and Access Management (IAM) authorization for Network File System (NFS) and EFS Access Points.
-
Mind Your State for Your State of Mind: Pat Helland at QCon SF
The features of different types of data storage should be considered when selecting how data is stored in a system. Is always reading correct data, or low latency, most important? In his keynote at this year’s QCon San Francisco, Pat Helland described trends in storage and computing, durable and session state semantics, and other aspects of storage like transactions, identity and immutability.
-
Amazon Releases AWS Lake Formation to General Availability
Recently, Amazon announced the general availability (GA) of AWS Lake Formation, a fully managed service that makes it much easier for customers to build, secure, and manage data lakes.
-
Microsoft Announces New Azure Analytics Services ADLS, ADX and More
Microsoft has announced the general availability of two new Azure analytics services - Azure Data Lake Storage Gen2 (ADLS) and Azure Data Explorer (ADX). Furthermore, Microsoft also announced the preview of Azure Data Factory Mapping Data Flow.
-
Amazon Introduces Intelligent-Tiering for S3 Storage to Automatically Optimize Costs
Amazon introduces a new S3 Storage tier called Intelligent-Tiering which optimizes storage costs by automatically selecting the most cost-effective storage tier based on usage patterns. This new tier can help reduce costs for customers infrequently accessing their data in S3.
-
Amazon S3 Increases Request Rate Performance and Drops Randomized Prefix Requirement
Amazon Web Services (AWS) recently announced significantly increased S3 request rate performance and the ability to parallelize requests to scale to the desired throughput. Notably this performance increase also "removes any previous guidance to randomize object prefixes" and enables the use of "logical or sequential naming patterns in S3 object naming without any performance implications".
-
Facebook Open Sources LogDevice - a Distributed Data Store for Log Storage
Facebook open sourced their internal distributed log storage project called LogDevice. It offers high write availability using replication, durable log storage and recovery from failure.