Facebook Introduces Chef To Manage Its Web-Tier

by Matthias Marschall on Feb 23, 2013 |

Facebook rolled out Private Chef, Opscode's commercial infrastructure automation product, to manage its web-tier. To ensure that Chef meets Facebook's scalability requirements they helped design the latest version of Chef Server, which is a total re-write using Erlang.

Facebook claims they are happy with using Chef so far and will present details at the ChefConf in late April. Phil Dibowitz, production engineer at Facebook, told The Register that Chef was the only automation solution flexible enough to bend to their scale dynamics without requiring them to change their workflow.

Chef seems to gain traction in large scale deployments:

Luke Kanies from Puppet Labs, makers of Puppet and competing with Opscode in the infrastructure automation area, says:

It's impressive that Opscode has gotten to this scale, but we've been at this scale for the last three or four years

He names Zynga with 50.000 servers and an upcoming deployment at the CERN nuclear physics research lab in Switzerland with up to 300,000 servers to prove his point.


Rate this Article


Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread, Chef, and Hadoop by John Martin

Matthias - First of all, thank you for the link to our webinar with Opscode about Edmunds' use of Chef for building/managing our Hadoop infrastructure. It's been a wonderful experience for us at Edmunds. As you've pointed out, that particular project was the first visible success story for Chef. We're very happy to be involved in the Los Angeles Chef User community and recently presented on our homegrown application deployment tool - Kingpin - which is built entirely around Chef. We're continuing our adoption and really excited to talk with the community at large about our adventures with such an awesome tool. I'd expect to hear much more from us in the near future about how we're taking advantage of it as our CM of choice.

One slight correction in your bullet though I'd like to make. We are indeed managing around 2,500 hosts with Chef, but not all of those are for our Hadoop clusters. We only have 70-80 hosts in our Hadoop infrastructure managed with Chef at the moment. (Just a slight correction, but perhaps an important detail.) I don't see us getting into the 2,500 Hadoop cluster size for some time. ;)

Thanks again!

John Martin
Sr Director, Production Engineering

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

1 Discuss
General Feedback
Marketing and all content copyright © 2006-2016 C4Media Inc. hosted at Contegix, the best ISP we've ever worked with.
Privacy policy

We notice you're using an ad blocker

We understand why you use ad blockers. However to keep InfoQ free we need your support. InfoQ will not provide your data to third parties without individual opt-in consent. We only work with advertisers relevant to our readers. Please consider whitelisting us.