BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Register Sign in

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Log In

or

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

Accelerating Performance by Incrementally Integrating Rust into Existing Codebase

Lily Mara explains how to avoid high-risk software rewrites through incremental FFI refactoring. She shares how engineering teams can replace Python bottlenecks with Rust via PyO3, demonstrating how to achieve dramatic function-level speedups, seamless integration testing, and meaningful infrastructure cost savings without microservice overhead.

All in development

Architecture & Design

Featured in Architecture & Design

The Evolution of Agentic Harnesses: From Chains to Graph to Code

Agentic LLM systems have moved from linear prompt chains to graph-based workflows and, more recently, code-executing harnesses. Chains are simple but fragile, graphs add branching, retries, and validation, and code harnesses verify outputs through execution. The article advises validating model outputs and choosing the least complex design that meets reliability, speed, and cost needs.

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

Serving LLMs at Scale: The Hidden KV Cache Advantage

Khawaja Shams shares a distributed systems perspective on scaling LLM inference stacks efficiently. He discusses practical strategies for optimizing GPU utilization, managing KV cache memory cliffs, leveraging tiered storage, reducing tail latency, and implementing disaggregated prefill and decode architectures to improve overall fleet performance, cost economics, and availability.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

AI is an Amplifier: Scale High Performance, Not Dysfunction

Nathen Harvey shares insights from DORA research on AI adoption in software delivery. He explains why AI acts as an amplifier, how the DORA AI Capabilities Model drives outcomes, and why engineering leaders must evolve beyond bottlenecks like code reviews to achieve sustainable productivity, reduce delivery instability, and empower developers without burning out their teams.

All in culture-methods

DevOps

Featured in DevOps

Exploding GPUs and the AI Infrastructure Challenge

Andrew Martin discusses why AI security is fundamentally tied to Kubernetes security. He shares insights into the evolving AI threat landscape, covering non-deterministic agent behavior, GPU supply chain vulnerabilities, shared compute risks, and practical defense strategies - from prompt firewalling to agentic identity - to help secure cloud-native AI workloads in production environments.

All in devops

Events

Helpful links

Choose your language

AI Security & Privacy Engineering Certification

Secure and govern production AI systems, from sensitive data to guardrails, evals, and audits.
Online. Register now.

AI Engineering Certification

Work through your production AI decisions with senior engineers from other companies. Apply their perspectives to challenges from your own work.
Online. Register Now.

AI Engineering Certification

Building RAG pipelines or AI agents? Work through retrieval, context, evals, and reliability decisions with experienced practitioners.
Online. Register Now.

High-Performing Teams Certification

Compare team design, delivery flow, AI roles, and metrics with experienced practitioners.
Online. Register Now.

Architect Certification

Distributed systems, decentralized decisions, platform engineering, and AI architecture.
Online. Register Now.

QCon San Francisco

What's working across AI, architecture, and leadership, from the teams doing it.
Register. Early bird ends Nov 10.

QCon AI New York

Production AI across agents, context, evals, security, and infrastructure, from the senior engineers building it.
Register. Early bird ends Nov 10.

QCon London

What early-adopter teams have proven in production, across 15 engineering tracks.
Register. Early bird ends Nov 10.

QCon AI Boston

Learn from the decisions and trade-offs behind AI systems already running in production.
Registration open.

InfoQ Homepage Interviews Big Data Architecture at LinkedIn

Architecture & Design

Big Data Architecture at LinkedIn

Download

17:08

Bio

Siddharth "Sid" Anand has deep experience designing and scaling high-traffic web sites. He is a senior member of LinkedIn's Service Infrastructure team. Prior to joining LinkedIn, he served as Netflix's Cloud Database Architect, Etsy's VP of Engineering, a search engineer and researcher at eBay, and a performance engineer at Siebel Systems.

About the conference

Software is changing the world; QCon aims to empower software development by facilitating the spread of knowledge and innovation in the enterprise software development community; to achieve this, QCon is organized as a practitioner-driven conference designed for people influencing innovation in their teams: team leads, architects, project managers, engineering directors.

May 14, 2012

Interview with

Sid Anand

by

Michael Floyd

BT