InfoQ Homepage Data Storage Content on InfoQ
-
Mind Your State for Your State of Mind: Pat Helland at QCon SF
The features of different types of data storage should be considered when selecting how data is stored in a system. Is always reading correct data, or low latency, most important? In his keynote at this year’s QCon San Francisco, Pat Helland described trends in storage and computing, durable and session state semantics, and other aspects of storage like transactions, identity and immutability.
-
Amazon Releases AWS Lake Formation to General Availability
Recently, Amazon announced the general availability (GA) of AWS Lake Formation, a fully managed service that makes it much easier for customers to build, secure, and manage data lakes.
-
Microsoft Announces New Azure Analytics Services ADLS, ADX and More
Microsoft has announced the general availability of two new Azure analytics services - Azure Data Lake Storage Gen2 (ADLS) and Azure Data Explorer (ADX). Furthermore, Microsoft also announced the preview of Azure Data Factory Mapping Data Flow.
-
Amazon Introduces Intelligent-Tiering for S3 Storage to Automatically Optimize Costs
Amazon introduces a new S3 Storage tier called Intelligent-Tiering which optimizes storage costs by automatically selecting the most cost-effective storage tier based on usage patterns. This new tier can help reduce costs for customers infrequently accessing their data in S3.
-
Amazon S3 Increases Request Rate Performance and Drops Randomized Prefix Requirement
Amazon Web Services (AWS) recently announced significantly increased S3 request rate performance and the ability to parallelize requests to scale to the desired throughput. Notably this performance increase also "removes any previous guidance to randomize object prefixes" and enables the use of "logical or sequential naming patterns in S3 object naming without any performance implications".
-
Facebook Open Sources LogDevice - a Distributed Data Store for Log Storage
Facebook open sourced their internal distributed log storage project called LogDevice. It offers high write availability using replication, durable log storage and recovery from failure.
-
Amazon Announces AWS Storage Gateway Hardware Appliance
Amazon has announced their AWS Storage Gateway hardware appliance, which provides hybrid storage between on-premises applications and AWS’ storage services. By providing a hardware appliance, Amazon gives a preconfigured solution to cache data locally while synchronizing with the cloud.
-
Microsoft Announces the General Availability of the Immutable Storage Functionality in Azure Storage
With the immutable storage, feature blobs will be non-erasable and non-modifiable for a specific retention interval. Now Microsoft announced that this new feature is generally available in all public Azure regions after its preview since June of this year.
-
Bank of America - Blockchain Data Storage Patent Released
On April 12, the United States Patent and Trademark Office (USPTO) released a patent filing from the Bank of America outlining their plans for a permissioned blockchain implementation that enables personal and business data sharing. A user will authorize service providers to securely access their data, but only for the specific records they have access to.
-
Oral Arguments before Supreme Court in Microsoft Cloud Computing Case Focus on Legal Issues
On February 27, 2018, the Supreme Court of the United States heard oral arguments on the Microsoft cloud computing case. A ruling against Microsoft could require companies based in the United States to hand over to law enforcement data stored on foreign servers. U.S. based organizations might then not be able to provide cloud computing services to foreign countries.
-
The Infrastructure Behind Twitter: Scaling Networking, Storage and Provisioning
The Twitter Engineering team has recently provided an insight into the evolution and scaling of the core technologies behind their in-house infrastructure that powers the social media service. Core lessons shared included: Architect beyond the original specifications; there is no such a thing as a “temporary change or workaround”; and documenting best practices has been a “force multiplier”.
-
Microsoft Experimenting with Using Synthetic DNA for Digital Data Storage
Microsoft is carrying out experiments with synthetic DNA for digital data storage and has recently agreed to purchase ten million strands of DNA from genetics startup Twist Bioscience.
-
Collision: How Flash Storage Will Transform IT
Massive reductions in cost for flash storage along with new technologies promise to dramatically change how well IT shops can satisfy what's expected of them in the cloud era. John Roese, CTO of EMC lays out a case for why companies need to adopt new technologies in order to out-perform their competitors.
-
Flocker v1.0 Provides Docker Volume Migration and Storage Abstraction
At the London Microservice User Group July meetup, Kai Davenport presented a live demonstration of ClusterHQ’s Flocker v1.0 container data volume manager tool migrating a Docker storage volume between multiple containers running within a Docker Swarm.
-
Basho Announcements at RICON Conference
The RICON conference in Las Vegas last week brought together scholarship from industry and academia in a venue targeted at sharing the latest innovations in tools, technologies and concepts in the field of Distributed Systems. In hosting the conference Basho Technologies positions themselves as thought leaders in a challenging field.