InfoQ Homepage Distributed Systems Content on InfoQ
-
The Verification of a Distributed System
Caitie McCaffrey discusses the strategies for proving a correct system and less strenuous methods of testing, which can help increase our confidence that a system is doing the right thing.
-
BOSH - Twenty Years of Deployment Lessons in One Tool
Colin Humphreys talks about how the Cloud Foundry community deploys the distributed system powering the one of the most successful open source platforms, along with details on the tooling used.
-
Membership, Dissemination and Population Protocols
Sean Cribbs discusses practical applications of academic research with a large scale distributed system, as well as membership and dissemination protocols and their application in practice.
-
Adaptive Availability for Quality of Service
Theo Schlossnagle talks about lessons learned in building an always-on distributed time-series database with aggressive quality of service guarantees, and techniques for dealing with bad machines.
-
Ingest & Stream Processing - What Will You Choose?
Pat Patterson and Ted Malaska talk about current and emerging data processing technologies, and the various ways of achieving "at least once" and "exactly once" timely data processing.
-
Future of Container-Enabled Infrastructure
Brandon Philips describes how bringing containers, schedulers, and distributed systems together will create more reliable and greatly more trusted server infrastructures.
-
Monitoring and Troubleshooting Real-Time Data Pipelines
Alan Ngai and Premal Shah discuss best practices on monitoring distributed real-time data processing frameworks and how DevOps can gain control and visibility over these data pipelines.
-
Distributed Consensus: Making the Impossible Possible
Heidi Howard explores how to construct resilient distributed systems on top of unreliable components. Howard discusses which algorithms are best suited to different situations.
-
Distributed Systems in Practice, in Theory
Aysylu Greenberg discusses some of the new architectural patterns from systems she has worked on at Google and the related work that provides insights into the motivations behind them.
-
What We Talk about When We Talk about Distributed Systems
Alvaro Videla reviews distributed systems: async/sync, message passing, shared memory, failure detectors, leader election, consensus and different kinds of replication, and recommends related books.
-
The Mechanics of Testing Large Data Pipelines
Mathieu Bastian explores the mechanics of unit, integration, data and performance testing for large, complex data workflows, along with the tools for Hadoop, Pig and Spark.
-
Connecting Stream Processors to Databases
Gian Merlino discusses stream processors and a common use case - keeping databases up to date-, the challenges they present, with examples from Kafka, Storm, Samza, Druid, and others.