BT

Ready for InfoQ 3.0? Try the new design and let us know what you think!

rss
AI, ML & Data Engineering Follow 1109 Followers

The Evolution of Uber’s 100+ Petabyte Big Data Platform

by Hrishikesh Barua Follow 18 Followers on  Nov 10, 2018

Uber’s engineering team wrote about how their big data platform evolved from traditional ETL jobs with relational databases to one based on Hadoop and Spark. A scalable ingestion model, standard transfer format and a custom library for incremental updates are the key components of the platform.

Cloud Follow 377 Followers

Amazon Announces Immediate Availability of Asia Pacific (Mumbai) Region

by Kent Weare Follow 11 Followers on  Jul 05, 2016 1

On June 27th, Amazon announced the immediate availability of their 6th AWS Region in Asia Pacific. This region is in Mumbai, India and it joins other regions in Asia Pacific including Beijing, Seoul, Singapore, Sydney, and Tokyo. With the addition of Mumbai, Amazon is now up to 35 Availability Zones across 13 geographic Regions worldwide.

Followers

Uber Unveils its Realtime Market Platform

by João Miranda Follow 2 Followers on  Mar 15, 2015

Matt Ranney, Chief Systems Architect at Uber, gave an overview of their dispatch system, responsible for matching Uber's drivers and riders. Ranney explained the driving forces that led to a rewrite of this system. He described the architectural principles that underpin it, several of the algorithms implemented and why Uber decided to design and implement their own RPC protocol.

BT