Facebook Introduces Chef To Manage Its Web-Tier

| by Matthias Marschall Follow 0 Followers on Feb 23, 2013. Estimated reading time: 1 minute |

Facebook rolled out Private Chef, Opscode's commercial infrastructure automation product, to manage its web-tier. To ensure that Chef meets Facebook's scalability requirements they helped design the latest version of Chef Server, which is a total re-write using Erlang.

Facebook claims they are happy with using Chef so far and will present details at the ChefConf in late April. Phil Dibowitz, production engineer at Facebook, told The Register that Chef was the only automation solution flexible enough to bend to their scale dynamics without requiring them to change their workflow.

Chef seems to gain traction in large scale deployments:

Luke Kanies from Puppet Labs, makers of Puppet and competing with Opscode in the infrastructure automation area, says:

It's impressive that Opscode has gotten to this scale, but we've been at this scale for the last three or four years

He names Zynga with 50.000 servers and an upcoming deployment at the CERN nuclear physics research lab in Switzerland with up to 300,000 servers to prove his point.


Rate this Article

Adoption Stage

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread, Chef, and Hadoop by John Martin

Matthias - First of all, thank you for the link to our webinar with Opscode about Edmunds' use of Chef for building/managing our Hadoop infrastructure. It's been a wonderful experience for us at Edmunds. As you've pointed out, that particular project was the first visible success story for Chef. We're very happy to be involved in the Los Angeles Chef User community and recently presented on our homegrown application deployment tool - Kingpin - which is built entirely around Chef. We're continuing our adoption and really excited to talk with the community at large about our adventures with such an awesome tool. I'd expect to hear much more from us in the near future about how we're taking advantage of it as our CM of choice.

One slight correction in your bullet though I'd like to make. We are indeed managing around 2,500 hosts with Chef, but not all of those are for our Hadoop clusters. We only have 70-80 hosts in our Hadoop infrastructure managed with Chef at the moment. (Just a slight correction, but perhaps an important detail.) I don't see us getting into the 2,500 Hadoop cluster size for some time. ;)

Thanks again!

John Martin
Sr Director, Production Engineering

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

1 Discuss

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you