InfoQ Homepage Presentations Randy Shoup on eBay's Architectural Principles
Randy Shoup on eBay's Architectural Principles
Summary
Randy Shoup covers the architectural principles eBay has used to grow and evolve its infrastructure to massive scale. It covers the forces ("-ilities") needed to contend with and design for scalability, availability, manageability, etc. He outlines eBay's architectural principles which meet - and trade off - those forces and describes reusable patterns for each strategy with eBay examples.
Bio
Randy Shoup is a Distinguished Architect in the eBay Marketplace Architecture group. Since 2004, he has been the primary architect for eBay's search infrastructure. Prior to eBay, he was Chief Architect at Tumbleweed Communications, and held a variety of roles at Oracle and Informatica. He has a BS in Mathematical and Computational Science, and an AB in Political Science, from Stanford University.
About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.
Community comments
Poor Audio
by Ray Krueger,
Re: Poor Audio
by Surender Kumar,
Re: Poor Audio
by Surender Kumar,
Great presentation... have you checked out this design pattern project?
by Damon Edwards,
Re: Great presentation... have you checked out this design pattern project?
by Randy Shoup,
ppt
by mario reyna,
Re: ppt
by Randy Shoup,
Re: ppt
by Siva S,
Re: ppt
by Venkat Mynampati,
Re: ppt
by Pierluigi Vernetto,
Fantastic presentation
by Olivier Gourment,
Poor Audio
by Ray Krueger,
Your message is awaiting moderation. Thank you for participating in the discussion.
Unfortunately the audio on this goes to hell about 15 minutes in. Don't listen with the volume too loud or you'll be punished with really loud static blasts. Ironicly the static blasts only seem to occur when he says important things :P
Re: Poor Audio
by Surender Kumar,
Your message is awaiting moderation. Thank you for participating in the discussion.
Now it doesn't start even.
Re: Poor Audio
by Surender Kumar,
Your message is awaiting moderation. Thank you for participating in the discussion.
sorry, it does but takes a while.
Great presentation... have you checked out this design pattern project?
by Damon Edwards,
Your message is awaiting moderation. Thank you for participating in the discussion.
Great presentation, Randy.
Have you checked out the nascent Design Patterns Project over at the Open Management Consortium?
www.open-management.com/community/open_standard...
The early efforts are around design patterns for automation, but many of the themes you touched on are well within the project's scope (of being a neutral repository for operations design patterns).
-Damon
dev2ops.org
Re: Great presentation... have you checked out this design pattern project?
by Randy Shoup,
Your message is awaiting moderation. Thank you for participating in the discussion.
Hi, Damon --
Glad you liked the presentation.
Thanks a lot for the pointer to the Design Patterns Project -- I hadn't known about it before. Looks like it is off to an encouraging start. I'll be interested to see how it evolves. It certainly would be valuable to have a repository for such patterns.
-- Randy
ppt
by mario reyna,
Your message is awaiting moderation. Thank you for participating in the discussion.
hello randy. where can i download the presentation?
it seems like you apply very well a federated database system(or virtual database)
thanks in advance
Re: ppt
by Randy Shoup,
Your message is awaiting moderation. Thank you for participating in the discussion.
Hi, Mario --
A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou...
You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale.
One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop.
-- Randy
Fantastic presentation
by Olivier Gourment,
Your message is awaiting moderation. Thank you for participating in the discussion.
Thank you Randy for sharing this brilliant material with us (Note: I have only read the PDF). Obviously, a number of strategies only apply to the range of massive traffic that eBay has (otherwise they come at the price of a difficult maintenance). But, still, I believe the principles are fundamentally right, and should be applied to any potentially large web site.
Re: ppt
by Siva S,
Your message is awaiting moderation. Thank you for participating in the discussion.
Randy,
Thanks for the great presentation, I couldnt able to download the pdf, getting error (The requested URL /qcon/sf2007/slides/public/RandyShoup_eBayArchPrinciples.pdf was not found on this server.) Could you please sent me .
Thanks a lot.
-Siva
Re: ppt
by Venkat Mynampati,
Your message is awaiting moderation. Thank you for participating in the discussion.
Hi,
Where can I get this pdf...
"A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (qcon.infoq.com/sanfrancisco/tracks/show_track.j...). Here is a direct link: www.eos1.dk/qcon/sf2007/slides/public/RandyShou..."
Apparently the link is broken
Re: ppt
by Pierluigi Vernetto,
Your message is awaiting moderation. Thank you for participating in the discussion.
qconsf.com/dl/QConSF2007/slides/public/RandySho... seems to be the right place