InfoQ Homepage Distributed Systems Content on InfoQ
-
Serving LLMs at Scale: the Hidden KV Cache Advantage
Khawaja Shams explains how distributed systems engineering solves modern LLM inference bottlenecks, covering KV caching, memory cliffs, prompt prefilling, and disaggregated execution.
-
Actors for Agents: Patterns for Production AI
Manju Rajashekhar discusses why the actor model provides the ideal runtime architecture for moving AI agents from simple demos to production-grade, long-running, fault-tolerant systems.
-
How to Find Resilience Bugs in Systems that Don't Exist
Hillel Wayne explains how formal methods principles - like properties, verification, and environments - help software engineers uncover subtle concurrency bugs and architectural flaws early.
-
How Eve Online Leverages Head Based Sampling to Observe "Fun"
Nicholas Herring explains how EVE Online balances cost and fidelity using 100% head-based dynamic and deterministic sampling to monitor a 20-year-old monolith alongside modern domain services.
-
The Agent Harness: Control Planes, Invariants, and Approval Boundaries for Production AI Agents
OpenAI’s Vinoth Govindarajan explains how to build reliable AI agent harnesses in production, focusing on state ownership, mutation ordering, scoped authority, and user-visible proof of action.
-
From DVDs to Global Streaming: How Netflix’s Commerce Architecture Actually Evolved
Kasia Trapszo explains how Netflix evolved its commerce platform, making pragmatic architectural trade-offs through global expansion, regulatory shifts, domain splits, and live-event scaling.
-
Understanding Progressive Collapse: How To Avoid A Cascading Failure
Sam Newman explains how to apply civil engineering’s concept of progressive collapse to digital systems, sharing actionable techniques to mitigate cascading failures in complex cloud architecture.
-
Parting the Clouds: the Rise of Disaggregated Systems
Murat Demirbas explains how cloud economics drive compute-storage disaggregation in modern database architectures. He shares insights on network bottlenecks, Paxos origins, and future tech.
-
Latency: the Race to Zero...Are We There Yet?
Amir Langer explains the critical role of predictable low latency in fintech, sharing lessons from the past and modern techniques like kernel bypass and Aeron to push systems toward zero latency.
-
The Ideal Micro-Frontends Platform
Luca Mezzalira discusses the evolution of micro-frontends, explaining how to scale engineering teams through technical decentralization, business subdomain boundaries, and organizational autonomy.
-
Fast Eventual Consistency: inside Corrosion, the Distributed System Powering Fly.io
Somtochi Onyekwere discusses Corrosion, Fly.io's eventual consistent service discovery tool. She explains how the networking team leverages SQLite and CRDTs to replicate data across 800+ nodes.
-
Scaling Cloud and Distributed Applications: Lessons and Strategies from chase.com, #1 Banking Portal in the US
Durai Arasan shares how Chase.com achieved a 71% latency reduction. He explains strategies for efficient scaling, multi-region resilience, and automated "repaving" to secure large-scale systems.