InfoQ

News

Article: Implementing Master-Worker with Terracotta

Posted by Floyd Marinescu on Feb 11, 2008 04:37 PM

Community
Java
Topics
Performance & Scalability,
Grid Computing,
Clustering & Caching
Tags
Terracotta
Recently Shine Technologies distributed one of its applications using Terracotta, an open-source JVM-level data clustering project.   Terracotta is often used to implement HTTP session replication, as a distributed cache, for transparent POJO Clustering / Spring integration, but can also be used to distribute events (such as tasks in a master/worker grid pattern).  In this case study, Shine Technologies explained how they used Terracotta and the Master Worker pattern to process large volumes of electricity usage data weekly and generate reports with detailed reconciliation & discrepancy highlighting for their customers.

Read Implementing Master-Worker with Terracotta.

3 comments

Reply

We did something similar, but adding routing by Mark Turansky Posted Feb 5, 2008 8:16 AM
Re: We did something similar, but adding routing by Orion Letizi Posted Feb 10, 2008 11:05 AM
Thank you by Tim Ferguson Posted Feb 10, 2008 9:50 PM
  1. Back to top

    We did something similar, but adding routing

    Feb 5, 2008 8:16 AM by Mark Turansky

    I wrote an article about how we built a message bus with TC that includes queuing, routing, splitting, and aggregation (all from Enterprise Integration Patterns). The slickest part is that we've got a pure POJO program that can run in an IDE, but then be distributed (via TC) to dozens on nodes in our production environment.

  2. Back to top

    Re: We did something similar, but adding routing

    Feb 10, 2008 11:05 AM by Orion Letizi

    The "pure POJO program that can run in an IDE, but then be distributed" thing is the what excites me. That's not one of the benefits that gets trumpeted very loudly, but it's really one of my favorites. It really lets you concentrate on the task at hand instead of fighting with a bunch of exposed infrastructure every time you want to run a test. Cheers, Orion

  3. Back to top

    Thank you

    Feb 10, 2008 9:50 PM by Tim Ferguson

    Thank you for this simple yet powerful writeup. Perhaps I have been under a rock for a bit, but Terracotta had just come onto my radar recently and this is exactly what I needed to understand more fully how, when, and where I can use this... thanks again. -Tim Ferguson, xaware.org

Exclusive Content

Rationalizing the Presentation Tier

Thin client paradigm characterized by web applications is a kludge that needs to be repudiated. Old compromises are no longer needed and it's time to move the presentation tier to where it belongs.

Agile Project Management: Lessons Learned at Google

In this presentation filmed during QCon 2007, Jeff Sutherland, the creator of Scrum, talks about his visit at Google to do an analysis of Google's first implementation of Scrum.

AtomServer – The Power of Publishing for Data Distribution

In this article, Bryon Jacob and Chris Berry introduce AtomServer, their implementation of a full-fledged Atom Store based on Apache Abdera, which is now available as open source.

An Introduction to Virtualization

It is easy to think that virtualization applies only to servers. In reality the recent resurgence of the concept is also being applied to networking, storage, and application infrastructure.

REST Anti-Patterns

In this article, Stefan Tilkov explains some of the most common anti-patterns found in applications that claim to follow a "RESTful" design and suggests ways to avoid them.

Choosing between Routing and Orchestration in an ESB

In this article, Adrien Louis and Marc Dutoo discuss the differences and relative merits of using orchestration vs. routing in a typical ESB setup, and discuss various implementation options.

Enterprise Batch Processing with Spring

Wayne Lund discusses batch processing, Spring Batch objectives and features, scenarios for usage, Spring Batch architecture, scaling, example code, failures and retrying, and the future roadmap.

User Story Estimation Techniques

Developer Jay Fields draws on his experiences as a ThoughtWorks consultant to describe effective user story estimation techniques.