InfoQ

InfoQ

News

My Bookmarks

Login or Register to enable bookmarks for unlimited time.

The content has been bookmarked!

There was an error bookmarking this content! Please retry.

Presentation: Behind the Scenes at MySpace.com

Posted by Abel Avram on Feb 10, 2009

Sections
Operations & Infrastructure,
Enterprise Architecture,
Development,
Architecture & Design
Topics
Performance & Scalability ,
Architecture ,
Enterprise Architecture ,
.NET ,
Configuration Management ,
.NET Framework
Tags
MySpace ,
PowerShell ,
IIS

In this presentation filmed during QCon SF 2008, Dan Farino, Chief Systems Architect at MySpace, talked about administering thousands of web servers from a system’s architect viewpoint. He mostly detailed the performance counter monitoring used by MySpace, the system profiler and the system administration site demoing the tools for the audience to see how it works.

Watch: Behind the Scenes at MySpace.com (49 min.)

Dan started his presentation with a short historical look at site’s evolution. MySpace initially had ColdFusion pages delivered by IIS 5.0 running on Win2k machines. Now, the site has about 3,000 IIS 6.0 servers with ASP.NET 2.0 with some WCF and WWF on .NET 3.5.

After that, Dan showed how the performance counter monitor works by watching all servers and reporting in real time if there is one of them that needs more investigation and possibly action taken to ensure proper functionality of the machine.

Next was the profiler which takes one request every 10 seconds and traces all its related activity in order to determine if there are potential problems developing on the respective machine.

The last tool presented was the system administration site. Initially they used VB scripts and batch files which did not scale well. Now they are using PowerShell which offers the scalability necessary to administer thousands of servers.

Dan answered questions during the last third of the session.

Slides garbled by Bela Ban Posted
Re: Slides garbled by Diana Plesa Posted
Sound level is very low by Ovidiu EFTIMIE Posted
Re: Sound level is very low by Floyd Marinescu Posted
Re: Sound level is very low by Jim Nasium Posted
  1. Back to top

    Slides garbled

    by Bela Ban

    The slides are unreadable, I tried both Firefox and Safari, can you correct this ?

  2. Back to top

    Re: Slides garbled

    by Diana Plesa

    The issue has been fixed.
    Diana

  3. Back to top

    Sound level is very low

    by Ovidiu EFTIMIE

    The sound level is very low

  4. Back to top

    Re: Sound level is very low

    by Floyd Marinescu

    There is a second volume control in the flash video window itself, make sure it is at 100%? The video is quite loud and normal for me.

  5. Back to top

    Re: Sound level is very low

    by Jim Nasium

    I have the sound level on the flash player turn all the way up and it is REALLY loud for me. hth

Educational Content

10 tips on how to prevent business value risk

One category of risk that project teams need to ensure they address is business value failure – delivering a product that fails to provide value for the business investor.

Interview: Software Systems Architecture: Working With Stakeholders Using Viewpoints and Perspectives

InfoQ spoke to the authors of Software Systems Architecture on a couple of new topics, the System Context viewpoint and Agile, which have been added to the second edition.

Beauty Is in the Eye of the Beholder

Alex Papadimoulis discusses ugly code, where it comes from, how to avoid it, and how to get rid of it.

Architecting Visa for Massive Scale and Continuous Innovation

John Davies examines Visa’s architecture and shows how enterprises have architected complex integrations incorporating Hadoop, memcached, Ruby on Rails, and others to deliver innovative solutions.

Max Protect: Scalability and Caching at ESPN.com

Sean Comerford unveils ESPN.com’s architecture, what components are used and why, and the current changes the website goes through.

The Seven Deadly Sins of Enterprise Agile Adoption

Are there repeated patterns of failure on Enterprise Agile Enablement efforts? Sanjiv and Arlen discuss Seven Deadly Sins to avoid when adopting Agile in an enterprise.

Questions for an Enterprise Architect

Erik Dörnenburg answers: What is Enterprise and Evolutionary Architecture?, discussing 4 issues: Turning strategy into execution, Ensuring conformance, Where do the architects sit? Buying or building?

Wrap Your SQL Head Around Riak MapReduce

Sean Cribbs explains what Map-Reduce and Riak are, why and how to use Map-Reduce with Riak, and how to convert SQL queries into their Map-Reduce equivalents.