InfoQ

News

Amazon adds a machine image marketplace to EC2

Posted by Jean-Jacques Dubray on Jul 31, 2007 03:58 AM

Community
Architecture
Topics
Grid Computing ,
Deployment / Datacenter
Tags
Amazon ,
EC2

Last April, Amazon organized a well attended half day presentation about AWS components: S3 (Amazon Simple Storage Service) and EC2 (Amazon Elastic Computing Cloud). They also featured some of the customer success stories. Companies such are SmartSheet, SmugMug, are using AWS’s S3 as an expandable infrastructure to store their customers documents and images.

As of April, about 240,000 developers have registered to use S3 to store 5 billion data objects, up from 800 million in July 2006. End users reported major hardware and operation cost savings. However this type of infrastructure services may well be the defining factor between success and failure when you are faced to scale massively storage, bandwidth and CPUs in a matter of days.

While S3 is limited to store documents, EC2 enables users to store their own machine image in the cloud and pay running instances as they need. Amazon guarantees that a VM will be up in less than 10 minutes (when in some IT organizations it might take anywhere from a few days to a few weeks). You have complete control over the image which may contain applications, libraries, data as well as configuration settings. Amazon also provides preconfigured Linux based template images.

Images themselves are stored in S3. The EC2 web service API allows you to configure security and network access, as well as start, terminate and monitor instances of your machine image.

Amazon is not the only company to have its head in the clouds. It is likely that Google, Yahoo and Microsoft will enter this ethereal battle with advanced business models and value add tools and services. Recently Steve Ballmer declared:

"We are in the process today of building out a services platform in the cloud," … "We have a lot of news and things that we'll be talking about and unveiling...this year."

After being a first mover, Amazon is now seeking to increase its competitive advantage. It unveiled a couple of weeks ago a marketplace that aims at creating a community of image developers to help their customers get the best variety of pre-packaged services and web applications. Klaas Bals has created an AMI (Amazon Machine Image) with Dupral 5.1 an open source Content Management System. Paul Dowman is offering a pre-configured Ruby On Rails AMI.

In his blog, Chris Petrilli, speculates that the idea that you could basically "buy" [an image] means that it’s possible people like RedHat, etc., might step in to provide "official support" for that kind of grid deployment.

Because virtualization is one of the top IT initiatives these days, it is likely that within a few months or a couple of years at the most, we will see large corporations using EC2 for the development, test and possibly production of mission critical applications. I don’t see today why any small to mid-size ISVs would not use AMIs for their routine development activities, one of the key feature of EC2 is of course the ability to create an environment for scalability testing activities.

I would not be surprised if "virtual appliances" start emerging from EC2 such as XSLT transformation engine. Why not an ESB too? It could well be that Shai Agassi, the former VP of Product and Technology at SAP is going to be right when he sais that EC2 "[is] the most important industry development in the last 10 years".

Terracotta on EC2 by Geert Bevin Posted Jul 31, 2007 5:21 PM
Re: Terracotta on EC2 by Dorel Vaida Posted Aug 2, 2007 7:59 AM
Re: Terracotta on EC2 by Geert Bevin Posted Aug 3, 2007 6:36 AM
  1. Back to top

    Terracotta on EC2

    Jul 31, 2007 5:21 PM by Geert Bevin

    I've been meaning to setup an AMI that has Terracotta configured on Ubuntu with Tomcat session clustering, and another AMI with a Terracotta server. Anyone has some thoughts or suggestions on what you'd like to see on those images and how it should be setup? Do you think this would be something you would use, for testing out Terracotta easily on multiple nodes, or for a very flexible and easy to setup production environment?

  2. Back to top

    Re: Terracotta on EC2

    Aug 2, 2007 7:59 AM by Dorel Vaida

    look into the terracotta blogs, one of your colleagues actually has tested a terracotta enabled application and run it in a 4 AMI cluster. Or maybe it's not one of your colleagues ? Don't remember exactly

  3. Back to top

    Re: Terracotta on EC2

    Aug 3, 2007 6:36 AM by Geert Bevin

    Yes, Orion has played with it before, without any real planning though, nor structure application setup or configuration. If we provide a public AMI image, I think we need to make is as fool-proof as possible and provide a good, but not exhaustive, ground for deploying and building your own solutions with it.

Educational Content

Bindings, Platforms, and Innovation

This presentation focuses on the Internet and separating myth from fact, history from the future, and the mundane from the imaginative. Bob Frankston presents a vision of what could and should be.

Orchestrating Long Running Activities with JBoss / JBPM

This article explores the use of JBoss and jBPM to implement design solutions that effectively address the issue of orchestrating long running activities.

Neo4j - The Benefits of Graph Databases

This presentation covers the use of graph databases as an optimal solution for data that is difficult to fit in static tables, rapidly evolving data or data that has a lot of optional attributes.

Realistic about Risk: Software development with Real Options

This session introduces Real Options and shows how it can help in running your project. Real Options is a decision-making process that can be used to manage risk.

Communication Flexibility Using Bindings

This article discusses the use of bindings on services and references (including the instance of non-configured bindings) as the means to implement SCA communications in a Web and SOA environment.

Writing DSLs in Groovy

After a short introduction to DSLs, Scott Davis plays with the keyboard showing how to approach the creation of a DSL by typing working snippets of Groovy code that get executed.

Scaling Agile with C/ALM (Collaborative Application Lifecycle Management)

IBM Rational and InfoQ present, Scaling Agile with C/ALM, an eBook showing organizations how to become “finely tuned software delivery machines” by enabling team integration and scaling.

Concurrent Programming with Microsoft F#

Amanda Laucher presents a real life enterprise application written in F#. She shows actual code snippets, explaining design decisions and suggesting how to use some of the F# constructs.