BT
Older rss
45:00

Data Preparation for Data Science: A Field Guide

Posted by Casey Stella  on  Apr 23, 2017 Posted by Casey Stella  on  Apr 23, 2017

Casey Stella presents a utility written with Apache Spark to automate data preparation, discovering missing values, values with skewed distributions and discovering likely errors within data.

46:03

Straggler Free Data Processing in Cloud Dataflow

Posted by Eugene Kirpichov  on  Apr 11, 2017 Posted by Eugene Kirpichov  on  Apr 11, 2017

Eugene Kirpichov describes the theory and practice behind Cloud Dataflow's approach to straggler elimination, and the associated non-obvious challenges, benefits, and implications of the technique.

46:03

Scaling up Near Real-Time Analytics @Uber &LinkedIn

Posted by Chinmay Soman  on  Mar 30, 2017 Posted by Chinmay Soman Yi Pan  on  Mar 30, 2017

Chinmay Soman and Yi Pan discuss how Uber and LinkedIn use Apache Samza, Calcite and Pinot along with the analytics platform AthenaX to transform data to make it available for querying in minutes.

45:22

Effective Data Pipelines: Data Mngmt from Chaos

Posted by Katharine Jarmul  on  Mar 29, 2017 Posted by Katharine Jarmul  on  Mar 29, 2017

Katharine Jarmul discusses implementation decisions for those looking for a practical recommendation on the "what" and "how" of data automation workflows.

48:49

Building Data Pipelines in Python

Posted by Marco Bonzanini  on  Mar 28, 2017 Posted by Marco Bonzanini  on  Mar 28, 2017

Marco Bonzanini discusses the process of building data pipelines and all the steps necessary to prepare data, focusing on data plumbing and going from prototype to production.

40:48

Data Science in the Cloud @StitchFix

Posted by Stefan Krawczyk  on  Feb 17, 2017 Posted by Stefan Krawczyk  on  Feb 17, 2017

Stefan Krawczyk discusses how StitchFix used the cloud to enable over 80 data scientists to be productive and have easy access, covering prototyping, algorithms used, keeping schema in sync, etc.

44:06

Scaling the Data Infrastructure @Spotify

Posted by Mārtiņš Kalvāns  on  Jan 28, 2017 Posted by Mārtiņš Kalvāns Matti Pehrs  on  Jan 28, 2017

Mārtiņš Kalvāns and Matti Pehrs overview the Data Infrastructure at Spotify, diving into some of the data infrastructure components, such us Event Delivery, Datamon and Styx.

01:07:25

Data Microservices in the Cloud

Posted by Mark Pollack  on  Jan 08, 2017 Posted by Mark Pollack  on  Jan 08, 2017

Mark Pollack introduces Spring Cloud Data Flow enabling one to create pipelines for data ingestion, real-time analytics and data import/export, demoing apps that are deployed onto multiple runtimes.

39:14

Targeting Your Audience: Data Visualization to Communicate Data Insights

Posted by Randy Krum  on  Dec 16, 2016 Posted by Randy Krum  on  Dec 16, 2016

Randy Krum explains how to use the power of data visualization to convey actionable insights to an audience, making data clear and memorable by showing the audience what the data means.

50:44

Ingest & Stream Processing - What Will You Choose?

Posted by Pat Patterson  on  Aug 14, 2016 1 Posted by Pat Patterson Ted Malaska  on  Aug 14, 2016 1

Pat Patterson and Ted Malaska talk about current and emerging data processing technologies, and the various ways of achieving "at least once" and "exactly once" timely data processing.

30:55

Journey from Data Integration to Data Science

Posted by Michael Wise  on  Aug 11, 2016 Posted by Michael Wise  on  Aug 11, 2016

Michael Wise discusses the journey from having data integrated across an organization, to employing data science to make good use of it.

01:26:12

Data Driven Action: A Primer on Data Science

Posted by Sarah Aerni  on  Dec 13, 2015 Posted by Sarah Aerni Srivatsan Ramanujam Jarrod Vawdrey  on  Dec 13, 2015

S Aerni, S Ramanujam and J Vawdrey present approaches and open source tools for wrangling and modeling massive datasets, scaling Java applications for NLP on MPP through PL/Java and much more.

BT