InfoQ

News

Clustering Lucene with TerraCotta

Posted by Rob Thornton on Nov 08, 2006 01:06 PM

Community
Java
Topics
Clustering & Caching ,
Search
Tags
Lucene ,
Terracotta

Engineers at TerraCotta have detailed a new way to cluster lucene, the popular text search library from Apache. Their method involves implementing the lucene RAMDirectory interface and using TerraCotta DSO to share the RAMDirectory across JVMs.

Lucene is a popular, open-source text search library. There are several existing strategies to clustering Lucene. Steve and Orion at TerraCotta noted that it was used in several of the products they use in house and so decided it would be a good test of their clustering software. They first tried to cluster the lucene IndexWriter directly but they ran into some problems and so switched to using RAMDirectory.

Orion describes the RAMDirectory approach as being straightforward:

As you can see, dealing with the index is pretty simple. This example code isn't really any different with clustering enabled than it is without clustering. In fact, turning clustering on and off is as simple as invoking java with or without a couple of Terracotta options.

Orion has provided some example code, which he admits is unpolished, and promises to post a cleaned up version along with instructions soon.

2 comments

Reply

All clean by ARI ZILKA Posted Nov 15, 2006 6:50 AM
Re: All clean by Jackie Van Posted Nov 18, 2008 8:47 AM
  1. Back to top

    All clean

    Nov 15, 2006 6:50 AM by ARI ZILKA

    Orion has posted a cleaned up version for others to take advantage of:
    orionl.blogspot.com/

  2. Back to top

    Re: All clean

    Nov 18, 2008 8:47 AM by Jackie Van

    Wholesale lingerie directly from China?
    As a famous brand and specialized manufacturer of sexy clothing in China. We supply the international market with fashionable sexy lingerie and sexy costume since 2002. With advanced technology,all our products are of high quality. Now we have clients all around the world. Lingerie Wholesale and OEM are welcomed!
    As a Lingerie Manufacturer, Charmingirl has standard workshop and production line, professional designers and experienced workers.
    We do Wholesale Underwear,
    Lingerie Wholesale, including corset and bustier,
    Sexy Lingerie Wholesale, including bikini, underwear
    Lingerie Wholesale, and Babydolls, Sexy Lingerie Wholesale, and
    Sexy Lingerie Wholesale including sleepwear,clubwear.
    Lingerie Wholesale from China: Lingerie China, you will find the
    Leather Lingerie and PVC Lingerie, also you can buy
    Christmas Costume and Xmas Lingerie
    for your Christmas Lingerie Christmas day.
    Our Wholesale center: Sexy Lingerie Wholesale can do Lingerie Wholesale online.
    Halloween Costume,
    also wholesale Adult Costume with fashion Babydoll Babydoll, and bra and panties Bra and Panties, Sexy Uniform Sexy Uniform is also our major products.
    we have strong ability on production, research and technology, advanced facilities that is imported fromGermany and Japan, now our monthly output is 100000 pcs.

Exclusive Content

Clojure

Rich Hickey discusses Clojure features and syntax, example code, functional programming, concurrency semantics, transactions, software transactional memory, agents, implementation and pain points.

Composite Oriented Programming with Qi4j

We introduce the concept of Composite Oriented Programming, and show how it avoids the issues with OOP and reignites the hope of being able to compose domain models with reusable pieces.

Dan Farino About MySpace’s Architecture

Dan Farino talks about the system architecture and the challenges faced when building a very large online community. Dan explains how a .NET product scales on hundreds of servers.

Principles and Practices of Lean-Agile Software Development

Alan Shalloway, CEO and founder of Net Objectives, presents the Lean software development principles and practices and how they can benefit to Agile practitioners.

The Maxine VM

Bernd Mathiske discusses Maxine VM, Java compatibility, swapping major VM components, research areas, Object handling, code examples, optimizing compiler, snippets, bytecode generation, JNI and JIT.

Joe Armstrong About Erlang

Joe Armstrong speaks on various aspects of the Erlang language, presenting its roots, how it compares with other languages and why it has become popular these days.

The Limits of Code Optimization: a new Singleton Pattern Implementation

The java double-check singleton pattern is not thread safe and can’t be fixed. In this article, Dr. Alexey Yakubovich provides an implementation of the Singleton pattern that he claims is thread-safe.

Pressure and Performance – The CTO's Dilemma

Diana and Jim talk about patterns observed in CTOs' activity. CTOs emerge as real people caring for other people in their organization, and are put under a lot of pressure and constraints.