BT

InfoQ Homepage News AWS Adds Dense-Storage Instances to Amazon EC2

AWS Adds Dense-Storage Instances to Amazon EC2

Bookmarks

Amazon Web Services announced a new instance type called D2 which is optimised for Massively Parallel Processing (MPP) data warehouses, log processing, and MapReduce applications.

When compared to its predecessor, the HS1 instance type, D2 instances deliver more compute power and memory. They can sustain a high rate of sequential disk I/O when accessing large data sets. Based on Intel Xeon E5–2676 v3 (code name Haswell), the processors run at a base clock frequency of 2.4 GHz.

The highest configuration of D2 instances called d2.8xlarge can deliver up to 3,500 MB/second read and 3,100 MB/second write performance with a 2 MiB block size. Latest version of Linux operating system with kernel 3.8 or later is required to get the best disk throughput. The updated kernel utilizes the latest Xen hypervisor feature, persistent grants, which is optimised for high-end host machines with many physical cores. Linux AMIs based on Amazon Linux AMI 2015.03, Ubuntu Server 14.04 LTS, Red Hat Enterprise Linux 7.1, and SUSE Linux Enterprise Server 12 support persistent grants.

Since the storage is local, additional redundancy must be built into the architecture. Amazon recommends implementing RAID and using a fault-tolerant file system such as HDFS or Gluster.

D2 instances are EBS-optimized that are designed to deliver dedicated block storage throughput ranging from 500 Mbps to 4,000 Mbps. EBS-optimized instances have a dedicated network to deal with the EBS I/O.

When launching multiple instances that work together, customers can take advantage of EC2 placement groups feature. According to the official AWS documentation, an EC2 placement group is a logical grouping of instances within a single Availability Zone. Using placement groups enables applications to participate in a low-latency, 10 Gbps network. Placement groups are recommended for applications that benefit from low network latency, high network throughput, or both. To provide the lowest latency, and the highest packet-per-second network performance for your placement group, choose an instance type that supports enhanced networking.

D2 instances come in four sizes that vary in configuration. Amazon EC2 instance page has more details of the pricing and configuration.

The new instance type is available in most of the AWS regions. Customers can launch instances as On-Demand, Reserved Instances, or Spot Instances.

Rate this Article

Adoption
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT

Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
Country/Zone:
State/Province/Region:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.