BT
Older rss
39:59
Architecture & Design Follow 2536 Followers

Scaling Marketplaces at Thumbtack

Posted by Nate Kupp  on  Mar 14, 2018 Posted by Nate Kupp Follow 0 Followers  on  Mar 14, 2018

Nate Kupp shares some of Thumbtack’s key learnings on their journey to scale and their future with fully-managed systems.

43:21
AI, ML & Data Engineering Follow 1065 Followers

Best Trade-off Point Algorithm for Efficient Resource Provisioning in Hadoop

Posted by Peter Nghiem  on  Oct 28, 2017 Posted by Peter Nghiem Follow 0 Followers  on  Oct 28, 2017

Peter Nghiem presents the Best Trade-off Point method and algorithm with mathematical formulas for obtaining the exact optimal number of task resources for any workload running on Hadoop.

40:48
AI, ML & Data Engineering Follow 1065 Followers

Data Science in the Cloud @StitchFix

Posted by Stefan Krawczyk  on  Feb 17, 2017 Posted by Stefan Krawczyk Follow 0 Followers  on  Feb 17, 2017

Stefan Krawczyk discusses how StitchFix used the cloud to enable over 80 data scientists to be productive and have easy access, covering prototyping, algorithms used, keeping schema in sync, etc.

33:53
AI, ML & Data Engineering Follow 1065 Followers

Streaming Live Data and the Hadoop Ecosystem

Posted by Oleg Zhurakousky  on  Jan 29, 2017 Posted by Oleg Zhurakousky Follow 0 Followers  on  Jan 29, 2017

Oleg Zhurakousky discusses the Hadoop ecosystem – Hadoop, HDFS, Yarn-, and how projects such as Hive, Atlas, NiFi interact and integrate to support the variety of data used for analytics.

30:29
AI, ML & Data Engineering Follow 1065 Followers

Achieving Mega-Scale Business Intelligence through Speed of Thought Analytics on Hadoop

Posted by Ian Fyfe  on  Oct 26, 2016 Posted by Ian Fyfe Follow 0 Followers  on  Oct 26, 2016

Ian Fyfe discusses the different options for implementing speed-of-thought business analytics and machine learning tools directly on top of Hadoop.

36:19
AI, ML & Data Engineering Follow 1065 Followers

The Mechanics of Testing Large Data Pipelines

Posted by Mathieu Bastian  on  Apr 24, 2016 Posted by Mathieu Bastian Follow 0 Followers  on  Apr 24, 2016

Mathieu Bastian explores the mechanics of unit, integration, data and performance testing for large, complex data workflows, along with the tools for Hadoop, Pig and Spark.

01:26:57
AI, ML & Data Engineering Follow 1065 Followers

Hadoop Workflows and Distributed YARN Apps using Spring Technologies

Posted by Thomas Risberg  on  Feb 21, 2016 Posted by Thomas Risberg Follow 2 Followers , Janne Valkealahti Follow 1 Followers  on  Feb 21, 2016

The authors discuss how Spring for Apache Hadoop can make developing workflows with Map Reduce, Spark, Hive and Pig jobs easier, and using Spring Cloud to build distributed apps for YARN.

01:11:54
AI, ML & Data Engineering Follow 1065 Followers

Federated Queries with HAWQ - SQL on Hadoop and Beyond

Posted by Christian Tzolov  on  Feb 04, 2016 Posted by Christian Tzolov Follow 0 Followers  on  Feb 04, 2016

Christian Tzolov shows different integration approaches between HAWQ and GemFire, showing using Spring XD to ingest GemFire data into HDFS and using Spring Boot to implement a RESTful proxy for HAWQ.

48:46
Followers

How 30 Years of Ticket Transaction Data Helps you Discover New Shows!

Posted by Vaclav Petricek  on  Aug 19, 2015 Posted by Vaclav Petricek Follow 0 Followers  on  Aug 19, 2015

Vaclav Petricek discusses how to train models, architect and build a scalable system powered by Storm, Hadoop, Spark, Spring Boot and Vowpal Wabbit that meets SLAs measured in tens of milliseconds.

49:53
Followers

Lightning Fast Cluster Computing with Spark and Cassandra

Posted by Piotr Kołaczkowski  on  Jun 17, 2015 Posted by Piotr Kołaczkowski Follow 0 Followers  on  Jun 17, 2015

Piotr Kołaczkowski discusses how they integrated Spark with Cassandra, how it was done, how it works in practice and why it is better than using a Hadoop intermediate layer.

35:16
AI, ML & Data Engineering Follow 1065 Followers

Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets

Posted by Eugene Mandel  on  Mar 12, 2015 Posted by Eugene Mandel Follow 0 Followers  on  Mar 12, 2015

Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.

01:15:43
Followers

Building a Recommendation Engine with Spring and Hadoop

Posted by Michael Minella  on  Mar 08, 2015 Posted by Michael Minella Follow 0 Followers  on  Mar 08, 2015

Michael Minella uses Spring XD and Spring Batch to orchestrate the full lifecycle of Hadoop processing and uses Apache Mahout to provide the audience with the recommendation processing.

BT