BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Topics

Choose your language

InfoQ Homepage Presentations Scaling Container Architectures with OSS & Mesos

Scaling Container Architectures with OSS & Mesos

Bookmarks
49:13

Summary

David Greenberg discusses how Two Sigma was able to scale up their research to harness tens of thousands of CPUs, and some of the challenges faced along the road to increasing the number of machines and the solutions they engineered to build a platform. He concludes by discussing the state of the infrastructure today, and how they leveraged open source software to build their platform.

Bio

David Greenberg is an independent consultant who previously worked at Two Sigma. He's interested in high performance software and distributed systems with Mesos. He's the author of the O'Reilly book "Building Applications on Mesos" and the designer of Cook, a Mesos framework written in Clojure and Datomic which coordinates containers to optimize task scheduling.

About the conference

Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Aug 07, 2016

BT