Older rss
Data Science Follow 590 Followers

Data Decisions with Real-Time Stream Processing

Posted by Serhat Yilmaz  on  Feb 28, 2018 Posted by Serhat Yilmaz Follow 0 Followers  on  Feb 28, 2018

Serhat Yilmaz talks about how Facebook is using stream processing at scale, the difficulties they have encountered and the solutions they have created to date.

Architecture & Design Follow 1506 Followers

Managing Data in Microservices

Posted by Randy Shoup  on  Feb 22, 2018 1 Posted by Randy Shoup Follow 20 Followers  on  Feb 22, 2018 1

Randy Shoup discusses managing data in microservices and shares proven patterns and practical advice that has been successful at Google, eBay, and Stitch Fix.

Development Follow 415 Followers

Designing Visualizations for Action

Posted by Chris Varosy  on  Feb 11, 2018 Posted by Chris Varosy Follow 0 Followers  on  Feb 11, 2018

Chris Varosy discusses strategies for designing data visualizations and dashboards that bring the insight users need to make decisions.

Architecture & Design Follow 1506 Followers

Data Consistency in Microservice Using Sagas

Posted by Chris Richardson  on  Jan 31, 2018 4 Posted by Chris Richardson Follow 32 Followers  on  Jan 31, 2018 4

Chris Richardson discusses messaging, durability, and reliability in microservice architectures leveraging the Saga Pattern, explaining how sagas work and introduces a saga framework for Java.

Data Science Follow 590 Followers

Systems That Learn

Posted by Stephen Buckley  on  Nov 05, 2017 Posted by Stephen Buckley Follow 0 Followers  on  Nov 05, 2017

Stephen Buckley discusses the Systems That Learn initiative which aims to create systems that learn by combining expertise in Systems and Machine Learning.

Development Follow 415 Followers

Homoiconicity: It Is What It Is

Posted by Stuart Sierra  on  Oct 31, 2017 Posted by Stuart Sierra Follow 4 Followers  on  Oct 31, 2017

Stuart Sierra demonstrates the power that comes from having the same data representation at all layers: programming language, specification, database, inter-process communication, and user interface.

Culture & Methods Follow 446 Followers

Data-Driven Coaching - Safely Turning Team Data into Coaching Insights

Posted by Troy Magennis  on  Oct 29, 2017 Posted by Troy Magennis Follow 3 Followers  on  Oct 29, 2017

Troy Magennis shows how to expose data to teams in order for them to retrospect productively, determine if a process experiment is panning out as expected, and to explore process change opportunities.

Data Science Follow 590 Followers

Machine Learning in Academia and Industry

Posted by Deborah Hanus  on  Oct 10, 2017 Posted by Deborah Hanus Follow 1 Followers  on  Oct 10, 2017

Deborah Hanus discusses some of the challenges that can arise when working with data.

Data Science Follow 590 Followers

AI-Based Data Extraction

Posted by George Roth  on  May 28, 2017 Posted by George Roth Follow  Followers  on  May 28, 2017

George Roth presents the challenges of data extraction from unstructured content in the context of preparing the data for Data Analytics.

Data Science Follow 590 Followers

Data Preparation for Data Science: A Field Guide

Posted by Casey Stella  on  Apr 23, 2017 Posted by Casey Stella Follow 0 Followers  on  Apr 23, 2017

Casey Stella presents a utility written with Apache Spark to automate data preparation, discovering missing values, values with skewed distributions and discovering likely errors within data.

Data Science Follow 590 Followers

Straggler Free Data Processing in Cloud Dataflow

Posted by Eugene Kirpichov  on  Apr 11, 2017 Posted by Eugene Kirpichov Follow 0 Followers  on  Apr 11, 2017

Eugene Kirpichov describes the theory and practice behind Cloud Dataflow's approach to straggler elimination, and the associated non-obvious challenges, benefits, and implications of the technique.

Architecture & Design Follow 1506 Followers

Scaling up Near Real-Time Analytics @Uber &LinkedIn

Posted by Chinmay Soman  on  Mar 30, 2017 Posted by Chinmay Soman Follow 1 Followers , Yi Pan Follow 0 Followers  on  Mar 30, 2017

Chinmay Soman and Yi Pan discuss how Uber and LinkedIn use Apache Samza, Calcite and Pinot along with the analytics platform AthenaX to transform data to make it available for querying in minutes.

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you