InfoQ

News

Amazon adds a machine image marketplace to EC2

Posted by Jean-Jacques Dubray on Jul 31, 2007

Community
Architecture
Topics
Deployment / Datacenter ,
Grid Computing
Tags
Amazon ,
EC2

Last April, Amazon organized a well attended half day presentation about AWS components: S3 (Amazon Simple Storage Service) and EC2 (Amazon Elastic Computing Cloud). They also featured some of the customer success stories. Companies such are SmartSheet, SmugMug, are using AWS’s S3 as an expandable infrastructure to store their customers documents and images.

As of April, about 240,000 developers have registered to use S3 to store 5 billion data objects, up from 800 million in July 2006. End users reported major hardware and operation cost savings. However this type of infrastructure services may well be the defining factor between success and failure when you are faced to scale massively storage, bandwidth and CPUs in a matter of days.

While S3 is limited to store documents, EC2 enables users to store their own machine image in the cloud and pay running instances as they need. Amazon guarantees that a VM will be up in less than 10 minutes (when in some IT organizations it might take anywhere from a few days to a few weeks). You have complete control over the image which may contain applications, libraries, data as well as configuration settings. Amazon also provides preconfigured Linux based template images.

Images themselves are stored in S3. The EC2 web service API allows you to configure security and network access, as well as start, terminate and monitor instances of your machine image.

Amazon is not the only company to have its head in the clouds. It is likely that Google, Yahoo and Microsoft will enter this ethereal battle with advanced business models and value add tools and services. Recently Steve Ballmer declared:

"We are in the process today of building out a services platform in the cloud," … "We have a lot of news and things that we'll be talking about and unveiling...this year."

After being a first mover, Amazon is now seeking to increase its competitive advantage. It unveiled a couple of weeks ago a marketplace that aims at creating a community of image developers to help their customers get the best variety of pre-packaged services and web applications. Klaas Bals has created an AMI (Amazon Machine Image) with Dupral 5.1 an open source Content Management System. Paul Dowman is offering a pre-configured Ruby On Rails AMI.

In his blog, Chris Petrilli, speculates that the idea that you could basically "buy" [an image] means that it’s possible people like RedHat, etc., might step in to provide "official support" for that kind of grid deployment.

Because virtualization is one of the top IT initiatives these days, it is likely that within a few months or a couple of years at the most, we will see large corporations using EC2 for the development, test and possibly production of mission critical applications. I don’t see today why any small to mid-size ISVs would not use AMIs for their routine development activities, one of the key feature of EC2 is of course the ability to create an environment for scalability testing activities.

I would not be surprised if "virtual appliances" start emerging from EC2 such as XSLT transformation engine. Why not an ESB too? It could well be that Shai Agassi, the former VP of Product and Technology at SAP is going to be right when he sais that EC2 "[is] the most important industry development in the last 10 years".

Terracotta on EC2 by Geert Bevin Posted Jul 31, 2007 5:21 PM
Re: Terracotta on EC2 by Dorel Vaida Posted Aug 2, 2007 7:59 AM
Re: Terracotta on EC2 by Geert Bevin Posted Aug 3, 2007 6:36 AM
  1. Back to top

    Terracotta on EC2

    Jul 31, 2007 5:21 PM by Geert Bevin

    I've been meaning to setup an AMI that has Terracotta configured on Ubuntu with Tomcat session clustering, and another AMI with a Terracotta server. Anyone has some thoughts or suggestions on what you'd like to see on those images and how it should be setup? Do you think this would be something you would use, for testing out Terracotta easily on multiple nodes, or for a very flexible and easy to setup production environment?

  2. Back to top

    Re: Terracotta on EC2

    Aug 2, 2007 7:59 AM by Dorel Vaida

    look into the terracotta blogs, one of your colleagues actually has tested a terracotta enabled application and run it in a 4 AMI cluster. Or maybe it's not one of your colleagues ? Don't remember exactly

  3. Back to top

    Re: Terracotta on EC2

    Aug 3, 2007 6:36 AM by Geert Bevin

    Yes, Orion has played with it before, without any real planning though, nor structure application setup or configuration. If we provide a public AMI image, I think we need to make is as fool-proof as possible and provide a good, but not exhaustive, ground for deploying and building your own solutions with it.

Educational Content

Brian Marick on 4 Challenges and 5 Guiding Values of Agile Software Development

Brian Marick takes us through a quick tour of the most important values and challenges to adopting Agile successfully (they aren't the typical challenges and values we hear in the community).

Are You a Software Architect?

The line between development and architecture is tricky. Does it exist at all? Is an ivory tower actually needed? There's a balance in the middle, but how do you move from developer to architect?

Agile – A Way of Life and Pragmatic Use of Authority

The word 'authority' sometimes produces an allergic response in hard-line agilists. Freedom and authority – both are bad if misused and both are good if used in right spirit for a noble cause.

Getting Started with Grails, Second Edition

"Getting Started with Grails" brings you up to speed on this modern web framework. Companies as varied as LinkedIn, Wired, and Taco Bell are all using Grails. Are you ready to get started as well?

Using ITIL V3 as a Foundation for SOA Governance

Those familiar with only ITIL V2 often scoff at the thought that ITIL could serve as a governance framework for SOA. With ITIL V3, the focus of the framework shifted towards service-orientation.

Adrian Colyer on AspectJ, tc Server and dm Server

SpringSource CTO Adrian Colyer discusses AspectJ, SpringSource's dm Server and tc Server products, OSGi and Scrum.

Adam Wiggins on Heroku

Heroku's Adam Wiggins talks about Rails, Background Jobs, Add-Ons, Ruby, and how Heroku manages to work around Ruby's inefficiencies using Erlang and other languages.

SOA as an Architectural Pattern: Best Practices in Software Architecture

For Grady Booch the foundation of a good architecture is patterns, SOA being just one of many patterns. In this Second Life presentation, Booch attempts to bring more clarity on what architecture is.