InfoQ

InfoQ

Presentation

My Bookmarks

Login or Register to enable bookmarks for unlimited time.

The content has been bookmarked!

There was an error bookmarking this content! Please retry.

Recorded at:
Recorded at

Randy Shoup on eBay's Architectural Principles

Presented by Randy Shoup on Feb 05, 2008 Length 00:54:52
Sections
Architecture & Design,
Enterprise Architecture
Topics
Enterprise Architecture ,
Performance & Scalability ,
Architecture
Tags
QCon ,
QCon San Francisco 2007 ,
Patterns ,
eBay ,
Automation
The next QCon is in London March 5-9, Join us!
 

How would you like to view the presentation?

In case you are having issues watching this video, please follow these simple steps to help us investigate the issue:
1. Right click on the video player and select Copy log
2. Paste the copied information in an email to video-issue@infoq.com (clicking this link will fill in the default details in most email clients).
Note: in case your email client hasn't automatically picked up the email subject, please include in your email the URL of the video too.
3. Done.
We will investigate the issue and get back to you as soon as possible. Thanks for helping us improve our site!
Summary
Randy Shoup covers the architectural principles eBay has used to grow and evolve its infrastructure to massive scale. It covers the forces ("-ilities") needed to contend with and design for scalability, availability, manageability, etc. He outlines eBay's architectural principles which meet - and trade off - those forces and describes reusable patterns for each strategy with eBay examples.

Bio
Randy Shoup is a Distinguished Architect in the eBay Marketplace Architecture group. Since 2004, he has been the primary architect for eBay's search infrastructure. Prior to eBay, he was Chief Architect at Tumbleweed Communications, and held a variety of roles at Oracle and Informatica. He has a BS in Mathematical and Computational Science, and an AB in Political Science, from Stanford University.

About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.

11 comments

Watch Thread Reply

Poor Audio by Ray Krueger Posted
Re: Poor Audio by Surender Kumar Posted
Re: Poor Audio by Surender Kumar Posted
Great presentation... have you checked out this design pattern project? by Damon Edwards Posted
Re: Great presentation... have you checked out this design pattern project? by Randy Shoup Posted
ppt by mario reyna Posted
Re: ppt by Randy Shoup Posted
Re: ppt by Siva S Posted
Re: ppt by Venkat Mynampati Posted
Re: ppt by Pierluigi Vernetto Posted
Fantastic presentation by Olivier Gourment Posted
  1. Back to top

    Poor Audio

    by Ray Krueger

    Unfortunately the audio on this goes to hell about 15 minutes in. Don't listen with the volume too loud or you'll be punished with really loud static blasts. Ironicly the static blasts only seem to occur when he says important things :P

  2. Back to top

    Re: Poor Audio

    by Surender Kumar

    Now it doesn't start even.

  3. Back to top

    Re: Poor Audio

    by Surender Kumar

    sorry, it does but takes a while.

  4. Back to top

    Great presentation... have you checked out this design pattern project?

    by Damon Edwards

    Great presentation, Randy.

    Have you checked out the nascent Design Patterns Project over at the Open Management Consortium?
    www.open-management.com/community/open_standard...

    The early efforts are around design patterns for automation, but many of the themes you touched on are well within the project's scope (of being a neutral repository for operations design patterns).

    -Damon
    dev2ops.org

  5. Back to top

    Re: Great presentation... have you checked out this design pattern project?

    by Randy Shoup

    Hi, Damon --

    Glad you liked the presentation.

    Thanks a lot for the pointer to the Design Patterns Project -- I hadn't known about it before. Looks like it is off to an encouraging start. I'll be interested to see how it evolves. It certainly would be valuable to have a repository for such patterns.

    -- Randy

  6. Back to top

    ppt

    by mario reyna

    hello randy. where can i download the presentation?
    it seems like you apply very well a federated database system(or virtual database)
    thanks in advance

  7. Back to top

    Re: ppt

    by Randy Shoup

    Hi, Mario --

    A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou...

    You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale.

    One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop.

    -- Randy

  8. Back to top

    Fantastic presentation

    by Olivier Gourment

    Thank you Randy for sharing this brilliant material with us (Note: I have only read the PDF). Obviously, a number of strategies only apply to the range of massive traffic that eBay has (otherwise they come at the price of a difficult maintenance). But, still, I believe the principles are fundamentally right, and should be applied to any potentially large web site.

  9. Back to top

    Re: ppt

    by Siva S

    Randy,
    Thanks for the great presentation, I couldnt able to download the pdf, getting error (The requested URL /qcon/sf2007/slides/public/RandyShoup_eBayArchPrinciples.pdf was not found on this server.) Could you please sent me .

    Thanks a lot.

    -Siva

    Hi, Mario --

    A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou...

    You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale.

    One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop.

    -- Randy

  10. Back to top

    Re: ppt

    by Venkat Mynampati

    Hi,

    Where can I get this pdf...

    "A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou..."

    Apparently the link is broken

  11. Back to top

    Re: ppt

    by Pierluigi Vernetto

Educational Content

Questions for an Enterprise Architect

Erik Dörnenburg answers: What is Enterprise and Evolutionary Architecture?, discussing 4 issues: Turning strategy into execution, Ensuring conformance, Where do the architects sit? Buying or building?

Wrap Your SQL Head Around Riak MapReduce

Sean Cribbs explains what Map-Reduce and Riak are, why and how to use Map-Reduce with Riak, and how to convert SQL queries into their Map-Reduce equivalents.

Polyglot Persistence for Java Developers - Moving Out of the Relational Comfort Zone

Chris Richardson shows how he ported a relational database to three NoSQL data stores: Redis, Cassandra and MongoDB.

The Golden Circle – Why How What

Jean Tabaka challenges the audience to reflect on what Agile practices they are employing, how they are using them, ending with the questions “Why have their organization chosen to go Agile?

The Web Platform as a Limitless Pool of Innovation, with Andreas Gal

Andreas talks about the benefits of the Open Web and how it compares to proprietary stacks. He also talks about various projects that push the envelope like Boot to Gecko, Broadway and pdf.js.

Hadoop and NoSQLin a Big Data Environment

Ron Bodkin discusses early adoption of Hadoop, NoSQL and describes MapReduce and related libraries and Frameworks. Other topics include Hive, Pig, multi tenancy, and security in a big data environment

Spring and Platform Interoperability

Stephen Bohlen explains how Spring helps with interoperability between Java and .NET, demoing it with the help of a sample application.

How to Stop Writing Next Year's Unsustainable Piece of Code

Guilherme Silveira mentions some of the turning points in project development that may affect the quality of the code offering advice on avoiding writing crappy code.