BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Register Sign in

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Log In

or

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

Python, Numba, and Algorithm Design: Building Efficient Models in Financial Services

Chad Schuster discusses bridging Python's developer velocity with C-like performance using Numba JIT and GPUs. Drawing from large-scale actuarial modeling, he explains LLVM pipeline architecture, performance gains up to 750x, and essential trade-offs like OOP limits, type inference errors, and compile-time overhead for engineering leaders scaling compute-heavy enterprise systems.

All in development

Architecture & Design

Featured in Architecture & Design

From DVDs to Global Streaming: How Netflix’s Commerce Architecture Actually Evolved

Kasia Trapszo discusses how Netflix evolved its commerce platform from a U.S. DVD service into global infrastructure. She explains navigating international payment realities, adapting to strict regulatory mandates, decomposing monolithic architectures along domain boundaries, and re-architecting systems for massive live-event demand - proving great systems survive by continually evolving.

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

Beyond Offset Lag: Computing Time in Queue for Apache Hudi Data Lake Pipelines at Petabyte Scale

In this article, author Srikanth Mamidala discusses the data lake architecture used for analytics, reporting, and machine learning and shows how to manage the consumer lag metrics when using Kafka and Apache Hudi.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

Rightsizing Platform Engineering: Building the Platform Your Organization Actually Needs

Shift-left and DevOps have impacted how we flow changes from inception to production, but at the cost of increased cognitive load and duplication of effort across testing, security, and maintenance. This article explores the real-world challenges of rightsizing developer platforms and finding a cultural match for engineering teams who use them to reduce cognitive load and deliver change faster.

All in culture-methods

DevOps

Featured in DevOps

Can Claude Fix Itself? Using LLMs for Incident Response

Anthropic reliability engineer Alex Palcuie shares practical lessons on using LLMs for real-world incident response. He explains where AI acts as a superhuman for observing logs and traces, why it still struggles with causation versus correlation during root-cause analysis, and how engineering leaders can integrate AI into on-call workflows without eroding human expertise.

All in devops

Events

Helpful links

Choose your language

AI Security & Privacy Engineering Certification

Secure and govern production AI systems, from sensitive data to guardrails, evals, and audits.
Online. Register now.

Architect Certification

Distributed systems, decentralized decisions, platform engineering, and AI architecture.
Online. Register Now.

Engineering Leadership Certification

Work through leadership decisions with senior peers facing similar technical trade-offs.
Online. Register Now.

AI-Assisted Engineering Certification

Your coding agent moves fast. Who checks whether it's making the codebase better?
Online. Register Now.

QCon San Francisco

What's working across AI, architecture, and leadership, from the teams doing it.
Register. Early bird ends August 11.

QCon AI New York

Production AI across agents, context, evals, security, and infrastructure, from the senior engineers building it.
Registration open.

QCon London

What early-adopter teams have proven in production, across 15 engineering tracks.
Register. Early bird ends August 11.

InfoQ Homepage Interviews The Larger Purpose of Big Data with Pavlo Baron

The Larger Purpose of Big Data with Pavlo Baron

Download

18:43

Bio

Pavlo Baron is lead architect with codecentric AG. His passion are distributed systems and large data sets – the infrastructure behind what they call Big Data. Pavlo is frequent conference speaker and has written three German books: “Erlang/OTP”, “Pragmatic IT Architecture” and “Fragile Agile”.

About the conference

Software is changing the world; QCon aims to empower software development by facilitating the spread of knowledge and innovation in the enterprise software development community; to achieve this, QCon is organized as a practitioner-driven conference designed for people influencing innovation in their teams: team leads, architects, project managers, engineering directors.

Jan 30, 2013

Interview with

Pavlo Baron

by

Harry Brumleve

BT