Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Vivek Yadav, an engineering manager from Stripe, shares his experience in building a testing system based on multi-year worth of data. He shares insights into why Apache Spark was the choice for creating such a system and how it fits in the "traditional" engineering practices.

All in development

Architecture & Design

Featured in Architecture & Design

Scaling Cloud and Distributed Applications: Lessons and Strategies

The article shares goals and strategies for scaling cloud and distributed applications, focusing on lessons learned from cloud migration at Chase.com at JP Morgan Chase. The discussion centers on three primary goals and the strategies addressing the goals, concluding how these approaches were achieved in practice. For those managing large-scale systems, these lessons provide valuable guidance!

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

GenAI Security: Defending Against Deepfakes and Automated Social Engineering

In this episode, QCon AI New York 2025 Chair Wes Reisz speaks with Reken CEO and Google Trust & Safety founder Shuman Ghosemajumder about the erosion of digital trust. They explore how deepfakes and automated social engineering are scaling cybercrime and argues defenders must move beyond default trust, utilizing behavioral telemetry and game theory to counter attacks that simulate human behavior.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

Transforming Life Sciences: AI, Vibe Coding, and Drug Development Acceleration

In this podcast, Shane Hastie, Lead Editor for Culture & Methods, spoke to Satish Kothapalli about the transformative impact of AI and vibe coding in life sciences software development, the acceleration of drug development timelines, and the evolving roles of developers in an AI-augmented environment.

All in culture-methods

DevOps

Featured in DevOps

Hybrid Cloud-Native Networking in Enterprise - Some Assembly Required

Louis Ryan shares a compelling vision for modern cloud native hybrid networking. He critiques primitive network abstractions (the "Big IP" problem) and rigid security policies that rot and cause SPOFs. Discover how architects can elevate network functionality, bake in identity (mTLS/PKI), and leverage composability to achieve repeatable policy enforcement everywhere their applications run.

All in devops

Events

Helpful links

Choose your language

QCon AI New York 2025

Go from AI demos to real engineering impact. Learn to embed LLMs, govern & scale securely.

SOLD OUT!

QCon London 2026

Learn what works in AI, architecture, data, security & FinTech.

Early Bird ends Dec 9.

QCon AI Boston

Learn how leading engineering teams run AI in production—reliably, securely, and at scale.

Launch pricing ends Dec 9.

InfoQ Homepage Apache Flight Content on InfoQ

Articles

RSS Feed

Architecture & Design

Engineering a Time Series Database Using Open Source: Rebuilding InfluxDB 3 in Apache Arrow and Rust

At times, to evolve your product, you need to rebuild it from scratch. The article provides the story behind the rewrite of InfluxDB from scratch using a different programming language - Rust - and stack - Apache Flight, Data Fusion, Apache Arrow and Parquet (FDAP). It emphasises the benefits, as well as the mechanics behind its operation and the different versions of the product.

Paul Dix
on Sep 10, 2025

Unlock the full InfoQ experience

Don't have an InfoQ account?

Topics

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Scaling Cloud and Distributed Applications: Lessons and Strategies

GenAI Security: Defending Against Deepfakes and Automated Social Engineering

Transforming Life Sciences: AI, Vibe Coding, and Drug Development Acceleration

Hybrid Cloud-Native Networking in Enterprise - Some Assembly Required

Helpful links

Choose your language

Articles

Engineering a Time Series Database Using Open Source: Rebuilding InfluxDB 3 in Apache Arrow and Rust

Lessons Learned in Migrating to Micro-Frontends by Luca Mezzalira at QCon SF

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Rust at the Core: Accelerating Polyglot SDK Development by Spencer Judge at QCon SF 2025

From On-Demand to Live : Netflix Streaming to 100 Million Devices in Under 1 Minute

Grab Adds Real-Time Data Quality Monitoring to Its Platform

Karrot Improves Conversion Rates by 70% with New Scalable Feature Platform on AWS

Transforming Life Sciences: AI, Vibe Coding, and Drug Development Acceleration

Growing Yourself as a Software Engineer, Using AI to Develop Software

Empathy Driven Platforms: You Build It, Let’s Run It Together

MySQL Repository Analysis Reveals Declining Development and Shrinking Contributor Base

Memori Expands into a Full-Scale Memory Layer for AI Agents across SQL and MongoDB

How Discord Scaled its ML Platform from Single-GPU Workflows to a Shared Ray Cluster

Hybrid Cloud-Native Networking in Enterprise - Some Assembly Required

NVIDIA Dynamo Addresses Multi-Node LLM Inference Challenges

System Initiative Unveils Expansion with Real-Time Multi-Cloud Discovery and Automation

QCon AI New York

QCon London

QCon AI Boston

InfoQ Software Architects' Newsletter

Articles