InfoQ Homepage Real-Time Data Content on InfoQ
-
Better Together - Using Spark and Redshift to Combine Your Data with Public Datasets
Eugene Mandel discusses challenges of conforming data sources and compares processing stacks: Hadoop+Redshift vs Spark, showing how the technology drives the way the problem is modeled.
/presentations/hadoop-redshift-spark/en/mediumimage/Eugenebig.jpg)
-
Applications of Enterprise Integration Patterns to Near Real-Time Radar Data Processing
Garrett Wampole describes an experimental methodology of applying Enterprise Integration Patterns to the near real-time processing of surveillance radar data, developed by MITRE.
/presentations/mitre-enterprise-integration/en/mediumimage/Garbig.jpg)
-
Design Patterns for Large-Scale Real-Time Learning
Sean Owen provides examples of operational analytics projects, presenting a reference architecture and algorithm design choices for a successful implementation based on his experience Oryx/Cloudera.
/presentations/pattern-real-time-learning/en/mediumimage/Seanbig.jpg)
-
From The Lab To The Factory: Building A Production Machine Learning Infrastructure
Josh Wills discusses using Hadoop technologies to build real-time data analysis models with a focus on strategies for data integration, large-scale machine learning, and experimentation.
/presentations/machine-learning-infrastructure/en/mediumimage/Joshbig.jpg)
-
Stream Processing: Philosophy, Concepts, and Technologies
Dan Frank discusses stream data processing and introduces NSQ – Bitly’s open source queuing system – and other new technologies used for communication between streaming programs.
/presentations/data-streaming-nsq/en/mediumimage/Danbig.jpg)
-
High Speed Smart Data Ingest into Hadoop
Oleg Zhurakousky discusses architectural tradeoffs and alternative implementations of real-time high speed data ingest into Hadoop.
/presentations/real-time-hadoop/en/mediumimage/Olegbig.jpg)
-
Making the Internet a Better Place: Scaling AppNexus
Mike Nolet shares lessons learned scaling AppNexus and architectural details of their system processing 30TB/day: Hadoop, DNS built in GSLB and Keepalived, and real-time data streaming built in C.
/presentations/appnexus-architecture-scalability/en/mediumimage/Mikebig.jpg)
-
Integrating SQL & NoSQL & NewSQL & Realtime Data Intelligence for the Financial Industry
Charles Cai, Ashwani Roy discuss a robust, cost effective, hypothetical solution to address extreme challenges in financial institutions, from decision making support to pricing and risk management.
/presentations/finance-sql-nosql-newsql/en/mediumimage/DOibig.jpg)
-
SocketStream - A New Framework for a New Web
Owen Barnes introduces SocketStream, a Node.js framework for building single-page real-time web applications that access all of their data via WebSocket.
/presentations/SocketStream/en/smallimage/Owen.JPG)
-
Facebook News Feed: Social Data at Scale
Serkan Piantino discusses news feeds at Facebook: the basics, infrastructure used, how feed data is stored, and Centrifuge – a storage solution.
/presentations/Facebook-News-Feed/en/smallimage/Pian.JPG)
-
Real-Time Delivery Architecture at Twitter
Raffi Krikorian details Twitter’s timeline architecture, its “write path” and “read path”, making it possible to deliver 300k tweets/sec.
/presentations/Real-Time-Delivery-Twitter/en/smallimage/Rafi.JPG)
-
View Server: Delivering Real-Time Analytics for Customer Service
Richard Tibbetts presents a three-tier architecture for real-time data staging analysis, storing the results and delivering them to clients as a service accessible through a variety of interfaces.
/presentations/Real-Time-Analytics-Service/en/smallimage/Richard.JPG)