InfoQ Homepage Hadoop Content on InfoQ

Articles

RSS Feed

Newer Older

Generating Avro Schemas from XML Schemas Using JAXB

Apache Avro is an up and coming binary marshalling framework. In his new article Benjamin Fagin explains how one can leverage existing XSD tooling to create data definitions and then use XJC plugin to directly generate AVRO schemes and marshaling classes.

Benjamin Fagin
on Mar 06, 2012
Exploring Hadoop OutputFormat

As more companies adopt Hadoop, its integration with other applications is becoming more important. A key to such integration is usage of the appropriate OutputFormat allowing to produce output data in a form most appropriate for other applications.

Jim.Blomo
on Dec 07, 2011
Extending Oozie

In this article authors show how leverage Oozie extensibility to implement custom language extensions. This approach can be viewed a specializing workflow language for a given company/line of business.

Boris Lublinsky Mike Segel
on Aug 02, 2011
An Open, Interoperable Cloud

This article describes how interoperable clouds can be created, today, through the integration of open standards such as the Open Cloud Compute Interface, the Open Virtualisation Format and CDMI. They provide the means to package virtual infrastructure deployments, an API for the runtime management of storage infrastructure and an API for the runtime management of infrastructure as service.

Andy Edmonds Thijs Metsch Eugene Luster
on Jul 19, 2011
Oozie by Example

End to end Oozie example, including process design, resource coordinator and workflow implementation

Boris Lublinsky Mike Segel
on Jul 18, 2011
Introduction to Oozie

Basic introduction to Oozie - a framework allowing to combine multiple Map/Reduce jobs into a logical unit of work.

Boris Lublinsky Michael Segel
on Jul 12, 2011
Using Apache Avro

Boris Lublinsky presents an introduction to AVRO and evaluate its usage for Schema componentization, inheritance and polymorphism. He also discusses backward compatibility issues and AVRO solutions for this problem.

Boris Lublinsky
on Jan 25, 2011
Data Mining in the Swamp: Taming Unruly Data With Cloud Computing

Matrix presents a white paper on using the open source tool, Hadoop, to implement the MapReduce strategy and a Cloud computing strategy to solve business intelligence problems.

John Brothers
on Aug 13, 2010
Clojure and Rails - the Secret Sauce Behind FlightCaster

FlightCaster, a realtime flight delay site, is built on Clojure and Hadoop for the statistical analysis. The web frontend is built with Ruby on Rails and hosted on Heroku. We talked to Bradford Cross about Clojure, functional programming and tips for OOP developers interested in making the jump.

Werner Schuster
on Aug 20, 2009
Yahoo's Doug Cutting on MapReduce and the Future of Hadoop

InfoQ's lead Java editor, Scott Delap, recently caught up with Hadoop project lead Doug Cutting. Hadoop is an open source distributed computing platform that includes implementations of MapReduce and a distributed file system. In this special InfoQ interview Cutting discusses how Hadoop is used at Yahoo, the challenges of its development, and the future direction of the project.

Scott Delap
on Sep 12, 2007