InfoQ

News

Presentation: Behind the Scenes at MySpace.com

Posted by Abel Avram on Feb 10, 2009

Community
.NET,
Architecture
Topics
Configuration Management ,
Enterprise Architecture ,
.NET Framework ,
Performance & Scalability
Tags
IIS ,
PowerShell ,
MySpace

In this presentation filmed during QCon SF 2008, Dan Farino, Chief Systems Architect at MySpace, talked about administering thousands of web servers from a system’s architect viewpoint. He mostly detailed the performance counter monitoring used by MySpace, the system profiler and the system administration site demoing the tools for the audience to see how it works.

Watch: Behind the Scenes at MySpace.com (49 min.)

Dan started his presentation with a short historical look at site’s evolution. MySpace initially had ColdFusion pages delivered by IIS 5.0 running on Win2k machines. Now, the site has about 3,000 IIS 6.0 servers with ASP.NET 2.0 with some WCF and WWF on .NET 3.5.

After that, Dan showed how the performance counter monitor works by watching all servers and reporting in real time if there is one of them that needs more investigation and possibly action taken to ensure proper functionality of the machine.

Next was the profiler which takes one request every 10 seconds and traces all its related activity in order to determine if there are potential problems developing on the respective machine.

The last tool presented was the system administration site. Initially they used VB scripts and batch files which did not scale well. Now they are using PowerShell which offers the scalability necessary to administer thousands of servers.

Dan answered questions during the last third of the session.

Slides garbled by Bela Ban Posted Feb 10, 2009 5:45 AM
Re: Slides garbled by Diana Plesa Posted Feb 10, 2009 6:18 AM
Sound level is very low by Ovidiu EFTIMIE Posted Feb 10, 2009 3:01 PM
Re: Sound level is very low by Floyd Marinescu Posted Feb 10, 2009 9:40 PM
Re: Sound level is very low by Jim Nasium Posted Feb 11, 2009 4:26 PM
  1. Back to top

    Slides garbled

    Feb 10, 2009 5:45 AM by Bela Ban

    The slides are unreadable, I tried both Firefox and Safari, can you correct this ?

  2. Back to top

    Re: Slides garbled

    Feb 10, 2009 6:18 AM by Diana Plesa

    The issue has been fixed.
    Diana

  3. Back to top

    Sound level is very low

    Feb 10, 2009 3:01 PM by Ovidiu EFTIMIE

    The sound level is very low

  4. Back to top

    Re: Sound level is very low

    Feb 10, 2009 9:40 PM by Floyd Marinescu

    There is a second volume control in the flash video window itself, make sure it is at 100%? The video is quite loud and normal for me.

  5. Back to top

    Re: Sound level is very low

    Feb 11, 2009 4:26 PM by Jim Nasium

    I have the sound level on the flash player turn all the way up and it is REALLY loud for me. hth

Educational Content

Brian Marick on 4 Challenges and 5 Guiding Values of Agile Software Development

Brian Marick takes us through a quick tour of the most important values and challenges to adopting Agile successfully (they aren't the typical challenges and values we hear in the community).

Are You a Software Architect?

The line between development and architecture is tricky. Does it exist at all? Is an ivory tower actually needed? There's a balance in the middle, but how do you move from developer to architect?

Agile – A Way of Life and Pragmatic Use of Authority

The word 'authority' sometimes produces an allergic response in hard-line agilists. Freedom and authority – both are bad if misused and both are good if used in right spirit for a noble cause.

Getting Started with Grails, Second Edition

"Getting Started with Grails" brings you up to speed on this modern web framework. Companies as varied as LinkedIn, Wired, and Taco Bell are all using Grails. Are you ready to get started as well?

Using ITIL V3 as a Foundation for SOA Governance

Those familiar with only ITIL V2 often scoff at the thought that ITIL could serve as a governance framework for SOA. With ITIL V3, the focus of the framework shifted towards service-orientation.

Adrian Colyer on AspectJ, tc Server and dm Server

SpringSource CTO Adrian Colyer discusses AspectJ, SpringSource's dm Server and tc Server products, OSGi and Scrum.

Adam Wiggins on Heroku

Heroku's Adam Wiggins talks about Rails, Background Jobs, Add-Ons, Ruby, and how Heroku manages to work around Ruby's inefficiencies using Erlang and other languages.

SOA as an Architectural Pattern: Best Practices in Software Architecture

For Grady Booch the foundation of a good architecture is patterns, SOA being just one of many patterns. In this Second Life presentation, Booch attempts to bring more clarity on what architecture is.