Serkan Piantino discusses news feeds at Facebook: the basics, infrastructure used, how feed data is stored, and Centrifuge – a storage solution.
Raffi Krikorian details Twitter’s timeline architecture, its “write path” and “read path”, making it possible to deliver 300k tweets/sec.
Richard Tibbetts presents a three-tier architecture for real-time data staging analysis, storing the results and delivering them to clients as a service accessible through a variety of interfaces.
Nathan Marz discusses Storm concepts –streams, spouts, bolts, topologies-, explaining how to use Storms’ Clojure DSL for real-time stream processing, distributed RPS and continuous computations.
Trotter Cashion introduces and demoes Chloe, a web server that handles real time data streaming between browsers and web applications written in any language and using any framework.
David Pollak discusses predicates, dependencies, functional languages and programming for the real-time cloud.
Nick Kallen discusses how Twitter handles large amounts of data in real time by creating 4 data types and query patterns -tweets, timelines, social graphs, search indices-, and the DBs storing them.
John Wang discusses LinkedIn real-time distributed search engine architecture and implementation details for People Search, Signal, Stream Indexing, Zoie, and Bobo.
Betfair is the world's largest betting exchange with a transaction volume the equivalent of over half the combined equity trading volume of every major stock exchange in the world. In response to an increase in transaction volume coupled with a decrease in value per transaction, Betfair launched a number of initiatives to dramatically increase transaction processing capacity and reduce cost.
In this presentation from QCon London 2008, Bertrand Delsart discusses real-time (RT) computing requirements in banking, RT Java history, priority semantics, RT APIs, Determinism and NoHeapRealtimeThreads, RT Garbage Collection, soft vs. hard RT, deadline miss handlers, event-driven requests with deadlines, reducing context switches, and benefits of RT Java and the RT Garbage collector.