BT
Newer rss

Storm: Distributed and Fault-tolerant Real-time Computation

Posted by Nathan Marz  on  Oct 21, 2011 1

Nathan Marz explain Storm, a distributed fault-tolerant and real-time computational system currently used by Twitter to keep statistics on user clicks for every URL and domain.

Big Data in Real Time at Twitter

Posted by Nick Kallen  on  Aug 03, 2011 2

Nick Kallen discusses how Twitter handles large amounts of data in real time by creating 4 data types and query patterns -tweets, timelines, social graphs, search indices-, and the DBs storing them.

NoSQL at Twitter

Posted by Ryan King  on  Jan 21, 2011

Ryan King presents how Twitter uses NoSQL technologies - Gizzard, Cassandra, Hadoop, Redis - to deal with increasing data amounts forcing them to scale out beyond what the traditional SQL has to offer

NoSQL at Twitter

Posted by Kevin Weil  on  Dec 23, 2010 6

Kevin Weil presents how Twitter does data analysis using Scribe for logging, base analysis with Pig/Hadoop, and specialized data analysis with HBase, Cassandra, and FlockDB.

Abstractions at Scale–Our Experiences at Twitter

Posted by Marius Eriksen  on  Dec 14, 2010 1

Marius Eriksen considers that leaky abstractions lead to scalability issues, while those providing narrow access to explicit resources - map-reduce, shared-nothing web apps, big table - scale better.

General Feedback
Bugs
Advertising
Editorial
InfoQ.com and all content copyright © 2006-2014 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we've ever worked with.
Privacy policy
BT