InfoQ Homepage Performance & Scalability Content on InfoQ
-
Fixing the AI Infra Scale Problem by Stuffing 1M Sandboxes in a Single Server
Felipe Huici discusses scaling microVM sandboxes for AI workloads, explaining how millisecond cold boots, high density, and stateful scale-to-zero achieve efficient, secure cloud isolation.
-
Instrumentation at Scale: Having Your Performance Cake and Eating It Too
Brian Martin explains how to achieve high-performance instrumentation without massive runtime overhead, comparing Rust metrics libraries, counter designs, and eBPF system telemetry techniques.
-
From DVDs to Global Streaming: How Netflix’s Commerce Architecture Actually Evolved
Kasia Trapszo explains how Netflix evolved its commerce platform, making pragmatic architectural trade-offs through global expansion, regulatory shifts, domain splits, and live-event scaling.
-
Producing the World's Cheapest Tokens: A How-to Guide
Meryem Arik explains how to cut AI inference costs by up to 90% by optimizing batch sizes, hardware selection, and request scheduling for high-volume, non-real-time workloads.
-
Keeping ChatGPT Fast as AI Development Accelerates
Martin Spier shares how agentic coding accelerates release velocity at OpenAI and explains how always-on AI agents redefine performance engineering to keep ChatGPT fast at massive scale.
-
From ms to µs: OSS Valkey Architecture Patterns for Modern AI
Dumanshu Goyal explains how moving from proxied architectures to direct access in Redis/Valkey slashes tail latency to microseconds, lowers costs, and eliminates single points of failure.
-
Million PDFs: Building a Modern Document Infrastructure with Rust and Typst
Erik Steiger explains how to replace heavy, outdated PDF engines like Crystal Reports and Puppeteer with a high-performance, serverless Rust and Typst pipeline, dropping render times below 2ms.
-
Architecting a Centralized Platform for Data Deletion at Netflix
Netflix Engineers Vidhya Arvind and Shawn Liu discuss the pillars of safe, large-scale data deletion. They explain strategies to eliminate data ghosts and manage tombstone resource contention.
-
How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud
Frank Yu explains how Coinbase builds ultra-high-performance exchanges. He discusses using single-threaded, deterministic core logic and Raft consensus to achieve sub-millisecond P99s in the cloud.
-
Scaling Cloud and Distributed Applications: Lessons and Strategies from chase.com, #1 Banking Portal in the US
Durai Arasan shares how Chase.com achieved a 71% latency reduction. He explains strategies for efficient scaling, multi-region resilience, and automated "repaving" to secure large-scale systems.
-
Architecting Planet Scale, Modern Apps in the Cloud
George Mao discusses the five stages of maturity for building a planet-scale, global, and highly available architecture using fully serverless, cloud-native services (GCP/AWS).
-
Scaling an Embedded Database for the Cloud – Challenges and Trade-Offs
Stephanie Wang discusses the tradeoffs and lessons learned from building a cloud-native data warehouse by scaling an embedded database, going from an in-process system to one with cloud capabilities.