InfoQ Homepage S3 Content on InfoQ
-
Amazon Offers Sustainability Datasets for Analysis
Amazon Web Services Open Data (AWSOD) and Amazon Sustainability (AS) are working together to make sustainability datasets available on the AWS Simple Storage Service (S3), and they are removing the undifferentiated heavy lifting by pre-processing the datasets for optimal retrieval. Sustainable datasets are commonly from satellites, geological studies, weather radars, agricultural studies, etc.
-
Amazon Introduces Intelligent-Tiering for S3 Storage to Automatically Optimize Costs
Amazon introduces a new S3 Storage tier called Intelligent-Tiering which optimizes storage costs by automatically selecting the most cost-effective storage tier based on usage patterns. This new tier can help reduce costs for customers infrequently accessing their data in S3.
-
Amazon S3 Increases Request Rate Performance and Drops Randomized Prefix Requirement
Amazon Web Services (AWS) recently announced significantly increased S3 request rate performance and the ability to parallelize requests to scale to the desired throughput. Notably this performance increase also "removes any previous guidance to randomize object prefixes" and enables the use of "logical or sequential naming patterns in S3 object naming without any performance implications".
-
Instana Extends AI Application Monitoring to AWS Lambda
Instana, a cloud-native provider of artificial intelligence based monitoring tools for dynamic containerized microservice applications, has extended support to include AWS Lambda, a serverless computing platform and also announced availability through the AWS Marketplace.
-
Amazon S3 Receives New Updates: New Storage Class and General Availability of S3 Select
Amazon S3 recently received new updates to its service: a new storage class S3 One Zone-Infrequent Access (Z-IA) Storage Class and S3 Select capability, now generally available for customers. With S3 Select, customers can get a subset of data faster, while the new storage One Zone IA class is a low-cost option for retrieving infrequent data.
-
A Human Error Took Down AWS S3 US-EAST-1
A mistake took down more S3 servers than it should, including two subsystems essential to S3 operation. This resulted in S3 failure, affecting the S3 service and other services depending on it. Normal functioning was restored in about four hours.
-
Fatigue, Spam, and Lack of Backups Take down GitLab.com
What started out as an attempt to protect GitLab.com from spammers turned sour as engineer fatigue and a lack of backups took the site down for nearly 18 hours and the loss of six hours worth of production data.
-
Netflix Details Evolution of Keystone Data Pipeline
Netflix has shed light on how the company uses the latest version of their Keystone Data Pipeline, a petabyte-scale real-time event stream processing system for business and product analytics. This news summarizes the three major versions of the pipeline, now used by almost every application at Netflix.
-
AWS Simplifies Resource Access with VPC Endpoints, Initially Supporting S3
Amazon Web Services recently introduced VPC endpoints to enable a "private connection between your VPC and another AWS service without requiring access over the Internet, through a NAT instance, a VPN connection, or AWS Direct Connect". VPC endpoint policies provide granular access control to other service's resources. Initially available are connections to S3, other services will be added later.
-
AWS s2n: Open-source TLS Implementation in Less than 6,000 Lines
Amazon Web Services has recently introduced s2n, short for “signal to noise”, an open-source implementation of the TLS/SSL protocols that aims to be “simple, small, fast, and with security as a priority”.
-
MemSQL 4 Database Supports Community Edition, Geospatial Intelligence and Spark Integration
Latest version of MemSQL, in-memory database with support for transactions and analytics, includes a new Community Edition for free use by organizations. MemSQL 4, released last week, also supports integration with Apache Spark, Hadoop Distributed File System (HDFS), and Amazon S3.
-
Microsoft Azure Tops Nasuni’s Storage Benchmark Test
Nasuni, the cloud NAS and storage company published the results of its annual cloud storage benchmarking test. Microsoft Azure Storage emerged as a winner on speed, availability, and scalability. Amazon S3 and Google Cloud Storage were the other services included in the benchmark.
-
Amazon DynamoDB Streams and Event Notifications for Amazon S3 Launched at AWS re:Invent 2014
In their move to event driven architecture, Amazon introduced two enabling technologies allowing the conversion of DynamoDB and S3 written data into events, which can be consumed by other applications and used by Lambda architecture.
-
Amazon Releases Services To Lure Enterprises to the Cloud
Amazon.com formally added three new capabilities to its cloud computing portfolio with the introduction of Direct Connect and the updates to the Virtual Private Cloud and Identity and Access Management services. These offerings are targeted at organizations looking to construct hybrid or private clouds on the Amazon Web Services platform.
-
Requester Pays: A New Amazon Business Model
Amazon has introduced a new business model for its S3 web services called Requester Pays. Businesses using S3 can mark up data buckets so their transfer will be paid by data requesters instead of being paid by their owners as it is now. Used in conjunction with DevPay, the new model opens new business opportunities for companies willing to share their data with others.