BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Topics

Choose your language

InfoQ Homepage Presentations Facebook’s Petabyte Scale Data Warehouse using Hive and Hadoop

Facebook’s Petabyte Scale Data Warehouse using Hive and Hadoop

Bookmarks
58:26

Summary

Ashish Thusoo and Namit Jain explain how Facebook manages to deal with 12 TB of compressed new data everyday with Hive’s help. Hive is an open source data warehousing framework built on Hadoop, allowing developers to perform analysis against large datasets using SQL.

Bio

Ashish Thusoo is currently managing the Facebook data infrastructure team. He is the project leader of Hive at Apache and a member of Hadoop PMC. Namit Jain is a member of Facebook’s data-infrastructure group and he is a committer for Hive. He also worked for over 10 years at Oracle on streaming technologies, XML, replication and queuing.

About the conference

QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community. QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.

Recorded at:

Feb 21, 2010

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • Cell phones

    by Brian Edwards,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    I wish people could turn cell phones off for 45 minutes.

  • Re: Cell phones

    by Gresham Paul,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    A great strategy for that is a charity box and a polite notice telling people you'll ask them to donate $10 if their phone rings. Once you've disturbed 100 other delegates I've never known anyone to not pay. It tends to work well for us.

  • Re: Cell phones

    by Hemlata Kalsha,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    I completely agree the mobile sound is very disturbing

  • Re: Cell phones

    by Archy Ty,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    The cell phone interference makes the presentation looks non-informative. It destruct... Maybe every conference, they need to put a cellphone jammer... if that's fine...

  • use a cell phone jammer

    by Patti Hych,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    really boring with the noises of phones, just go and buy a cell phone jammer, it is cool, used it for a long time!!
    www.jammerall.com/

  • Re: use a cell phone jammer

    by Brian Edwards,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    I know these jammers are illegal in the U.S. otherwise I'd carry one around with me all day long. I'm in favor of public stoning to the death although attendance might drop off.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT