BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Topics

Choose your language

InfoQ Homepage Presentations Randy Shoup on eBay's Architectural Principles

Randy Shoup on eBay's Architectural Principles

Bookmarks
54:52

Summary

Randy Shoup covers the architectural principles eBay has used to grow and evolve its infrastructure to massive scale. It covers the forces ("-ilities") needed to contend with and design for scalability, availability, manageability, etc. He outlines eBay's architectural principles which meet - and trade off - those forces and describes reusable patterns for each strategy with eBay examples.

Bio

Randy Shoup is a Distinguished Architect in the eBay Marketplace Architecture group. Since 2004, he has been the primary architect for eBay's search infrastructure. Prior to eBay, he was Chief Architect at Tumbleweed Communications, and held a variety of roles at Oracle and Informatica. He has a BS in Mathematical and Computational Science, and an AB in Political Science, from Stanford University.

About the conference

QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.

Recorded at:

Feb 05, 2008

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • Poor Audio

    by Ray Krueger,

  • Great presentation... have you checked out this design pattern project?

    by Damon Edwards,

  • ppt

    by mario reyna,

    • Re: ppt

      by Randy Shoup,

      • Poor Audio

        by Ray Krueger,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Unfortunately the audio on this goes to hell about 15 minutes in. Don't listen with the volume too loud or you'll be punished with really loud static blasts. Ironicly the static blasts only seem to occur when he says important things :P

      • Re: Poor Audio

        by Surender Kumar,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Now it doesn't start even.

      • Re: Poor Audio

        by Surender Kumar,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        sorry, it does but takes a while.

      • Great presentation... have you checked out this design pattern project?

        by Damon Edwards,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Great presentation, Randy.

        Have you checked out the nascent Design Patterns Project over at the Open Management Consortium?
        www.open-management.com/community/open_standard...

        The early efforts are around design patterns for automation, but many of the themes you touched on are well within the project's scope (of being a neutral repository for operations design patterns).

        -Damon
        dev2ops.org

      • Re: Great presentation... have you checked out this design pattern project?

        by Randy Shoup,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Hi, Damon --

        Glad you liked the presentation.

        Thanks a lot for the pointer to the Design Patterns Project -- I hadn't known about it before. Looks like it is off to an encouraging start. I'll be interested to see how it evolves. It certainly would be valuable to have a repository for such patterns.

        -- Randy

      • ppt

        by mario reyna,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        hello randy. where can i download the presentation?
        it seems like you apply very well a federated database system(or virtual database)
        thanks in advance

      • Re: ppt

        by Randy Shoup,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Hi, Mario --

        A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou...

        You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale.

        One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop.

        -- Randy

      • Fantastic presentation

        by Olivier Gourment,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Thank you Randy for sharing this brilliant material with us (Note: I have only read the PDF). Obviously, a number of strategies only apply to the range of massive traffic that eBay has (otherwise they come at the price of a difficult maintenance). But, still, I believe the principles are fundamentally right, and should be applied to any potentially large web site.

      • Re: ppt

        by Siva S,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Randy,
        Thanks for the great presentation, I couldnt able to download the pdf, getting error (The requested URL /qcon/sf2007/slides/public/RandyShoup_eBayArchPrinciples.pdf was not found on this server.) Could you please sent me .

        Thanks a lot.

        -Siva

        Hi, Mario --

        A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou...

        You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale.

        One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop.

        -- Randy

      • Re: ppt

        by Venkat Mynampati,

        Your message is awaiting moderation. Thank you for participating in the discussion.

        Hi,

        Where can I get this pdf...

        "A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou..."

        Apparently the link is broken

      • Re: ppt

        by Pierluigi Vernetto,

        Your message is awaiting moderation. Thank you for participating in the discussion.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT