InfoQ Homepage Scalability Content on InfoQ
-
Moving Past the Scaling Myth
Michael Feathers examines the notion of scale variant structuring and what systems design could look like without the assumption that structural reorganization at different scales is not necessary.
/presentations/scalability-variant-structuring/en/mediumimage/Michaelbig.JPG)
-
Scaling Instagram Infrastructure
Lisa Guo overviews Instagram's infrastructure, its history, multi-data center support, tuning uwsgi parameters for scaling, performance monitoring and diagnosis, and Django/Python upgrade.
/presentations/instagram-scale-infrastructure/en/mediumimage/Lisabig.JPG)
-
Machine Learning at Scale
Aditya Kalro discusses using large-scale data for Machine Learning (ML) research and some of the tools Facebook uses to manage the entire process of training, testing, and deploying ML models.
/presentations/machine-learning-scale/en/mediumimage/Adbig.JPG)
-
Deep Learning at Scale
Scott Le Grand describes his work at NVidia, Amazon and Teza, including the DSSTNE distributed deep learning framework.
/presentations/dsstne-deep-learning/en/mediumimage/Scobig.JPG)
-
Scaling up Near Real-Time Analytics @Uber &LinkedIn
Chinmay Soman and Yi Pan discuss how Uber and LinkedIn use Apache Samza, Calcite and Pinot along with the analytics platform AthenaX to transform data to make it available for querying in minutes.
/presentations/uber-linkedin-analytics/en/mediumimage/Chibig.JPG)
-
Petabytes Scale Analytics Infrastructure @Netflix
Tom Gianos and Dan Weeks discuss Netflix' overall big data platform architecture, focusing on Storage and Orchestration, and how they use Parquet on AWS S3 as their data warehouse storage layer.
/presentations/netflix-big-data-infrastructure/en/mediumimage/doiBIG.JPG)
-
Keep Calm and Carry on: Scaling Your Org
Charity Majors talks about what it means to do quality operations and software engineering in the year 2016 and beyond, as well as the implications for engineering teams and social systems.
/presentations/microservices-operations-2016/en/mediumimage/Chabig.JPG)
-
Scaling the Data Infrastructure @Spotify
Mārtiņš Kalvāns and Matti Pehrs overview the Data Infrastructure at Spotify, diving into some of the data infrastructure components, such us Event Delivery, Datamon and Styx.
/presentations/spotify-data-infrastructure/en/mediumimage/doibig.JPG)
-
Scaling Counting Infrastructure @Quora
Chun-Ho Hung and Nikhil Garg discuss Quanta, Quora's counting system powering their high-volume near-real-time analytics, describing the architecture, design goals, constraints, and choices made.
/presentations/quora-analytics/en/mediumimage/Robbig.JPG)
-
Scaling Quality on Quora Using Machine Learning
Nikhil Garg talks about the various Machine Learning problems that are important for Quora to solve in order to keep the quality high at such a massive scale.
/presentations/quora-machine-learning/en/mediumimage/Nikbig.JPG)
-
Scaling Dropbox
Preslav Le talks about how Dropbox’s infrastructure evolved over the years, how it looks today, as well the challenges and lessons learned on the way.
/presentations/dropbox-infrastructure/en/mediumimage/Prebig.JPG)
-
But I Need a Database that _Scales_
Aaron Spiegel reviews common scaling techniques for both relational and NoSQL databases, discussing trade-offs of these techniques and their effect on query flexibility, transactions and consistency.
/presentations/database-scalability-techniques/en/mediumimage/Aaronbig.JPG)