It has been possible to run Hadoop on EC2 for a while. Today Amazon simplified the process by announcing Amazon Elastic MapReduce which automatically deploys EC2 instances for computational use and includes a API for interacting with them.
Numerous projects have sprouted up around the popular Hadoop open source implementation of map reduce in the last year. Now Cloudera is releasing Cloudera Distribution for Hadoop, an open source product seeking to make it easier for company's to begin using Hadoop.
The Large Hadron Collider (LHC) is a particle accelerator that aims to revolutionize our understanding of our universe. The Worldwide LHC Computing Grid (LCG) project provides data storage and analysis infrastructure for the entire high energy physics community that will use the LHC.
Eucalyptus is an open-source software infrastructure for implementing cloud computing. Among its features is interface compatibility with EC2 (both Web service and Query interfaces).
Recently a few popular Ruby projects have started using Erlang. We look at how EngineYard's Vertebra, Powerset's Fuzed and recently Github make use of Erlang.
Almost a year on from their initial announcements around grids and cloud computing, Arjuna Technologies have released more details of what they're working on: a new Cloud-platform called Arjuna Agility that emphasises a non-invasive approach to getting the most out of your IT investments as they migrate to the cloud.
In this interview from QCon San Francisco 2007, Randy Shoup discusses the architecture of eBay. Topics discussed include eBay's architectural principles, horizontal and vertical partitioning, ACID vs. BASE, handling data inconsistency, distributed caching, updating eBay on the fly, architectural and coding standards, eBay's search infrastructure, grid computing, and SOA.
Appistry recently released a free 5 server community edition of their EAF product. InfoQ sat down with VP Sam Charrington to discuss this move and Appistry's overall place in the grid/cloud computing landscape.
The term "cloud computing" has shown up everywhere from the Web 2.0 conference to the enterprise architecture whiteboard sessions in big companies to the laptops of startup developers. The big question being asked now is "what is cloud computing?"
The latest version of Terracotta, an open source JVM clustering framework, includes new features like cluster visualization tools and official support for Tomcat 6 platform. Terracotta team announced on Monday, the general availability of version 2.6 of the product which also includes performance improvements in several common use-cases.
Heroku and Morph Labs are Ruby on Rails hosting providers, offering a complete stack of software and easy to use interfaces to get your applications up and running in a few minutes. We talked to both parties to find out more about their offers.
At IBM IMPACT this week, IBM announced a several new and re-randed upgraded products dealing with virtualization (Virtual Enterprise), clustering & caching (eXtreme Scale), complex event processing (Business Events), and RESTful web apps (sMash). InfoQ spoke to various execs and product managers to find out more.
The latest version of JPPF, a java based open source parallel processing framework, includes a networking tool called TCP port multiplexer to enable JPPF work in secure firewall environments. JPPF team released the version 1.1 of the framework which also includes JMX based node monitoring and management features.
The latest version of GridGain, a java based open source grid computing framework, supports load balancing and data partitioning features. GridGain Systems recently released version 2.0 of the framework which also includes a "work stealing" feature where the scheduled jobs running on overloaded nodes in the grid are "stolen" to run on underloaded nodes.
Mark Turansky detailed his implementation of a message bus architecture using Terracotta and Java 5. Instead of using an MQ or JMS based deployment, Mark took advantage of the Terracotta architecture to create his POJO message bus. This allowed for a clean, simple, and inexpensive infrastructure solution to his message needs.