BT

Your opinion matters! Please fill in the InfoQ Survey!

You are now in FULL VIEW
CLOSE FULL VIEW

Scio: Moving Big Data to Google Cloud, a Spotify Story
Recorded at:

| by Neville Li Follow  Followers on May 26, 2017 |

A note to our readers: As per your request we have developed a set of features that allow you to reduce the noise, while not losing sight of anything that is important. Get email and web notifications by choosing the topics you are interested in.

54:50

Summary
Neville Li tells the Spotify’s story of migrating their big data infrastructure to Google Cloud, replacing Hive and Scalding with BigQuery and Scio, which helped them iterate faster.

Sponsored Content

Bio

Neville Li is a software engineer at Spotify who works mainly on data infrastructure and tools for machine learning and advanced analytics. In the past few years he has been driving the adoption of Scala and new data tools for music recommendation, including Scalding, Spark, Storm and Parquet. Before that he worked on search quality at Yahoo! and old school distributed systems like MPI.

Entering its 12th year, the Emerging Technologies Conference has brought the leaders of the open source community to Philadelphia to teach about their projects, their work and how these technologies are changing software development. During this time, ETE has become one of the largest gatherings of developers in the mid-Atlantic.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT