BT

Your opinion matters! Please fill in the InfoQ Survey!

Older rss
43:21
Data Science Follow 329 Followers

Best Trade-off Point Algorithm for Efficient Resource Provisioning in Hadoop

Posted by Peter Nghiem  on  Oct 28, 2017 Posted by Peter Nghiem Follow 0 Followers  on  Oct 28, 2017

Peter Nghiem presents the Best Trade-off Point method and algorithm with mathematical formulas for obtaining the exact optimal number of task resources for any workload running on Hadoop.

40:48
Data Science Follow 329 Followers

Data Science in the Cloud @StitchFix

Posted by Stefan Krawczyk  on  Feb 17, 2017 Posted by Stefan Krawczyk Follow 0 Followers  on  Feb 17, 2017

Stefan Krawczyk discusses how StitchFix used the cloud to enable over 80 data scientists to be productive and have easy access, covering prototyping, algorithms used, keeping schema in sync, etc.

33:53
Data Science Follow 329 Followers

Streaming Live Data and the Hadoop Ecosystem

Posted by Oleg Zhurakousky  on  Jan 29, 2017 Posted by Oleg Zhurakousky Follow 0 Followers  on  Jan 29, 2017

Oleg Zhurakousky discusses the Hadoop ecosystem – Hadoop, HDFS, Yarn-, and how projects such as Hive, Atlas, NiFi interact and integrate to support the variety of data used for analytics.

30:29
Data Science Follow 329 Followers

Achieving Mega-Scale Business Intelligence through Speed of Thought Analytics on Hadoop

Posted by Ian Fyfe  on  Oct 26, 2016 Posted by Ian Fyfe Follow 0 Followers  on  Oct 26, 2016

Ian Fyfe discusses the different options for implementing speed-of-thought business analytics and machine learning tools directly on top of Hadoop.

36:19
Data Science Follow 329 Followers

The Mechanics of Testing Large Data Pipelines

Posted by Mathieu Bastian  on  Apr 24, 2016 1 Posted by Mathieu Bastian Follow 0 Followers  on  Apr 24, 2016 1

Mathieu Bastian explores the mechanics of unit, integration, data and performance testing for large, complex data workflows, along with the tools for Hadoop, Pig and Spark.

01:26:57
Data Science Follow 329 Followers

Hadoop Workflows and Distributed YARN Apps using Spring Technologies

Posted by Thomas Risberg  on  Feb 21, 2016 Posted by Thomas Risberg Follow 0 Followers , Janne Valkealahti Follow 0 Followers  on  Feb 21, 2016

The authors discuss how Spring for Apache Hadoop can make developing workflows with Map Reduce, Spark, Hive and Pig jobs easier, and using Spring Cloud to build distributed apps for YARN.

01:11:54
Data Science Follow 329 Followers

Federated Queries with HAWQ - SQL on Hadoop and Beyond

Posted by Christian Tzolov  on  Feb 04, 2016 Posted by Christian Tzolov Follow 0 Followers  on  Feb 04, 2016

Christian Tzolov shows different integration approaches between HAWQ and GemFire, showing using Spring XD to ingest GemFire data into HDFS and using Spring Boot to implement a RESTful proxy for HAWQ.

48:46
Followers

How 30 Years of Ticket Transaction Data Helps you Discover New Shows!

Posted by Vaclav Petricek  on  Aug 19, 2015 Posted by Vaclav Petricek Follow 0 Followers  on  Aug 19, 2015

Vaclav Petricek discusses how to train models, architect and build a scalable system powered by Storm, Hadoop, Spark, Spring Boot and Vowpal Wabbit that meets SLAs measured in tens of milliseconds.

49:53
Followers

Lightning Fast Cluster Computing with Spark and Cassandra

Posted by Piotr Kołaczkowski  on  Jun 17, 2015 Posted by Piotr Kołaczkowski Follow 0 Followers  on  Jun 17, 2015

Piotr Kołaczkowski discusses how they integrated Spark with Cassandra, how it was done, how it works in practice and why it is better than using a Hadoop intermediate layer.

35:16
Data Science Follow 329 Followers

Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets

Posted by Eugene Mandel  on  Mar 12, 2015 Posted by Eugene Mandel Follow 0 Followers  on  Mar 12, 2015

Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.

01:15:43
Followers

Building a Recommendation Engine with Spring and Hadoop

Posted by Michael Minella  on  Mar 08, 2015 Posted by Michael Minella Follow 0 Followers  on  Mar 08, 2015

Michael Minella uses Spring XD and Spring Batch to orchestrate the full lifecycle of Hadoop processing and uses Apache Mahout to provide the audience with the recommendation processing.

01:19:37
Followers

Apps + Data + Cloud: What Does It All Mean?

Posted by Matt Stine  on  Mar 08, 2015 Posted by Matt Stine Follow 0 Followers  on  Mar 08, 2015

Matt Stine presents how combine Spring Boot, Spring Data, Spring Reactor, Spring XD, Hadoop and run them in the cloud.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT