BT

Your opinion matters! Please fill in the InfoQ Survey!

rss
50:48
Data Science Follow 338 Followers

Big Data Infrastructure @ LinkedIn

Posted by Shirshanka Das  on  Apr 02, 2017 Posted by Shirshanka Das Follow 0 Followers  on  Apr 02, 2017

Shirshanka Das describes LinkedIn’s Big Data Infrastructure and its evolution through the years, including details on the motivation and architecture of Gobblin, Pinot and WhereHows.

45:26
DevOps Follow 306 Followers

Petabytes Scale Analytics Infrastructure @Netflix

Posted by Tom Gianos  on  Feb 15, 2017 Posted by Tom Gianos Follow 0 Followers , Dan Weeks Follow 0 Followers  on  Feb 15, 2017

Tom Gianos and Dan Weeks discuss Netflix' overall big data platform architecture, focusing on Storage and Orchestration, and how they use Parquet on AWS S3 as their data warehouse storage layer.

51:04
Followers

The Game of Big Data: Scalable, Reliable Analytics Infrastructure at KIXEYE

Posted by Randy Shoup  on  Jul 19, 2014 Posted by Randy Shoup Follow 5 Followers  on  Jul 19, 2014

Randy Shoup describes KIXEYE's analytics infrastructure from Kafka queues through Hadoop 2 to Hive and Redshift, built for flexibility, experimentation, iteration, testability, and reliability.

46:49
Followers

Data & Infrastructure at Airbnb

Posted by Brenden Matthews  on  Dec 31, 2013 Posted by Brenden Matthews Follow 0 Followers  on  Dec 31, 2013

Brenden Matthews describes the infrastructure built at Airbnb using Mesos in order to support Hadoop and Storm.

45:11
Followers

Making the Internet a Better Place: Scaling AppNexus

Posted by Mike Nolet  on  Oct 18, 2013 Posted by Mike Nolet Follow 0 Followers  on  Oct 18, 2013

Mike Nolet shares lessons learned scaling AppNexus and architectural details of their system processing 30TB/day: Hadoop, DNS built in GSLB and Keepalived, and real-time data streaming built in C.

Followers

Lean Data Architecture: Minimize Investment, Maximize Value

Posted by Manvir Singh Grewal  on  Jan 04, 2013 Posted by Manvir Singh Grewal Follow 0 Followers , Brandon Byars Follow 0 Followers  on  Jan 04, 2013

Manvir Singh Grewal and Brandon Byars propose a business intelligence workflow along with Lean principles and practices for implementing a data warehouse and reporting capability.

Followers

Big Data Problems in Monitoring at eBay

Posted by Bhaven Avalani  on  Dec 21, 2012 Posted by Bhaven Avalani Follow 0 Followers , Yuri Finklestein Follow 0 Followers  on  Dec 21, 2012

Bhaven Avalani and Yuri Finklestein discuss 4 aspects encountered at eBay when dealing with monitoring data: reduction of data entropy, robust data distribution, metric extraction, efficient storage.

Followers

Big Data, Small Computers

Posted by Cliff Click  on  Dec 20, 2012 Posted by Cliff Click Follow 1 Followers  on  Dec 20, 2012

Cliff Click discusses RAIN, H2O, JMM, Parallel Computation, Fork/Joins in the context of performing big data analysis on tons of commodity hardware.

Followers

Facebook News Feed: Social Data at Scale

Posted by Serkan Piantino  on  Nov 26, 2012 1 Posted by Serkan Piantino Follow 0 Followers  on  Nov 26, 2012 1

Serkan Piantino discusses news feeds at Facebook: the basics, infrastructure used, how feed data is stored, and Centrifuge – a storage solution.

Followers

Saving the World (from|with) Big Data

Posted by Bruce Durling  on  Sep 20, 2012 Posted by Bruce Durling Follow 0 Followers  on  Sep 20, 2012

Bruce Durling discusses the impact of cloud computing on the climate and what can be done to reduce the amount of CO2 generated by data centers in order to process big data.

Followers

"Big Data" and the Future of DevOps

Posted by Ram Singh  on  Aug 24, 2012 2 Posted by Ram Singh Follow 0 Followers  on  Aug 24, 2012 2

Ram C Singh discusses using Big Data for infrastructure telemetry along with good practices and an autonomic engine to create an autonomic computing infrastructure that might prevent downtime.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT