InfoQ

InfoQ

Presentation

My Bookmarks

Login or Register to enable bookmarks for unlimited time.

The content has been bookmarked!

There was an error bookmarking this content! Please retry.

Recorded at:
Recorded at

Facebook: Science and the Social Graph

Presented by Aditya Agarwal on Mar 25, 2009 Length 01:01:43
Sections
Enterprise Architecture
Topics
Enterprise Application Blocks ,
Architecture
Tags
Facebook ,
QCon ,
PHP ,
Memcache ,
MySQL ,
LAMP ,
QCon San Francisco 2008
The next QCon is in London March 5-9, Join us!
 

How would you like to view the presentation?

In case you are having issues watching this video, please follow these simple steps to help us investigate the issue:
1. Right click on the video player and select Copy log
2. Paste the copied information in an email to video-issue@infoq.com (clicking this link will fill in the default details in most email clients).
Note: in case your email client hasn't automatically picked up the email subject, please include in your email the URL of the video too.
3. Done.
We will investigate the issue and get back to you as soon as possible. Thanks for helping us improve our site!
Summary
In this presentation filmed during QCon SF 2008, Aditya Agarwal discusses Facebook’s architecture, more exactly the software stack used, presenting the advantages and disadvantages of its major components: LAMP (PHP, MySQL), Memcache, Thrift, Scribe.

Bio
Aditya Agarwal is Director of Engineering at Facebook, where he helps manage the engineering team and oversees new product design and architecture. He works on Search, Advertising and News Feed. He was one of the co-authors of Thrift, a popular open-source RPC framework.

About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community. QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.
Download the presentation by Steve Tirtha Posted
Re: Download the presentation by Dinh Pham Posted
Re: Download the presentation by Dinh Pham Posted
Re: Download the presentation by Brian Wood Posted
hmm. by Ivan Lazarte Posted
Re: hmm. by Max Indelicato Posted
Re: hmm. by Dan Creswell Posted
Nice presentation by benny rio Posted
Back to the future by Adrien Delorme Posted
  1. Back to top

    Download the presentation

    by Steve Tirtha

    Hi,

    can I download the presentation somewhere?

    Steve

  2. Back to top

    Re: Download the presentation

    by Dinh Pham

  3. Back to top

    Re: Download the presentation

    by Dinh Pham

    Or you can install Real Player. It will allow you to download all the slides in a bunch

  4. Back to top

    hmm.

    by Ivan Lazarte

    telling me php doesn't scale is like telling me java supports oo programming. five minutes of looking at that language told me that. the db stuff was slightly more interesting - more evidence as to the death of the traditional rdbms but in the end not that surprising. anything of facebooks scale can't support traditional clustering and has to drop to partitioning of some kind.

    their platform sounds like a mess of a variety of languages. "right language for the task" sounds to me like a euphemism for "i can't really control my vastly more experienced developers"

  5. Back to top

    Re: hmm.

    by Max Indelicato

    "their platform sounds like a mess of a variety of languages. "right language for the task" sounds to me like a euphemism for "i can't really control my vastly more experienced developers""

    This sounds to me like the a critique by someone who is afraid to move beyond their comfort zone.

  6. Back to top

    Re: hmm.

    by Dan Creswell

    "their platform sounds like a mess of a variety of languages. "right language for the task" sounds to me like a euphemism for "i can't really control my vastly more experienced developers""

    This sounds to me like the a critique by someone who is afraid to move beyond their comfort zone.


    Dunno about that but would note that Amazon also use a variety of languages and it's encouraged - Vogels says:

    "You build a small team. You give them this problem. And at Amazon, they're allowed to solve that problem in any way they see fit, as long as it is through this hardened API. They can pick the tools they want. They can do any design methodology they want as long as they deliver the actual functionality that they've been tasked with......We have some requirements: that services has to be monitorable, that they have to be tractable in all sorts of different ways. But in essence, operation is all up to the service owners themselves. This allows for a large-let's say controlled chaos-which actually works very well because everybody's responsible for their own services."

  7. Back to top

    Re: Download the presentation

    by Brian Wood

    Hi Dinh,

    Your link goes to one particular slide (6.swf). I can get to the others by editing the url, but is the a starting page, or a way to download all of the slides at once?

    Thanks for posting this presentation.

    Brian

  8. Back to top

    Nice presentation

    by benny rio

    seems like implementing SOA at lower level, great idea

  9. Back to top

    Back to the future

    by Adrien Delorme

    "[...]the other reason we use php apart from the fact that we started of on it[...]"

    With this phrase I just would like to ask, what would you use if you could go back to the very beginning of Facebook with the nowadays advances ?

    Java, Php, Ruby, Python etc. ?
    Rails, Zend, Symfony, your framework, reinventing the wheel etc. ?

Educational Content

Questions for an Enterprise Architect

Erik Dörnenburg answers: What is Enterprise and Evolutionary Architecture?, discussing 4 issues: Turning strategy into execution, Ensuring conformance, Where do the architects sit? Buying or building?

Wrap Your SQL Head Around Riak MapReduce

Sean Cribbs explains what Map-Reduce and Riak are, why and how to use Map-Reduce with Riak, and how to convert SQL queries into their Map-Reduce equivalents.

Polyglot Persistence for Java Developers - Moving Out of the Relational Comfort Zone

Chris Richardson shows how he ported a relational database to three NoSQL data stores: Redis, Cassandra and MongoDB.

The Golden Circle – Why How What

Jean Tabaka challenges the audience to reflect on what Agile practices they are employing, how they are using them, ending with the questions “Why have their organization chosen to go Agile?

The Web Platform as a Limitless Pool of Innovation, with Andreas Gal

Andreas talks about the benefits of the Open Web and how it compares to proprietary stacks. He also talks about various projects that push the envelope like Boot to Gecko, Broadway and pdf.js.

Hadoop and NoSQLin a Big Data Environment

Ron Bodkin discusses early adoption of Hadoop, NoSQL and describes MapReduce and related libraries and Frameworks. Other topics include Hive, Pig, multi tenancy, and security in a big data environment

Spring and Platform Interoperability

Stephen Bohlen explains how Spring helps with interoperability between Java and .NET, demoing it with the help of a sample application.

How to Stop Writing Next Year's Unsustainable Piece of Code

Guilherme Silveira mentions some of the turning points in project development that may affect the quality of the code offering advice on avoiding writing crappy code.