BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Register Sign in

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Log In

or

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

Accelerating Performance by Incrementally Integrating Rust into Existing Codebase

Lily Mara explains how to avoid high-risk software rewrites through incremental FFI refactoring. She shares how engineering teams can replace Python bottlenecks with Rust via PyO3, demonstrating how to achieve dramatic function-level speedups, seamless integration testing, and meaningful infrastructure cost savings without microservice overhead.

All in development

Architecture & Design

Featured in Architecture & Design

How to Find Resilience Bugs in Systems that Don't Exist

Hillel Wayne discusses how formal methods principles - such as property strength, state-space verification, and environment assumptions - help software engineers uncover critical architectural bugs early. He shares practical mental models like "adversarial non-determinism" to reason about concurrency, edge cases, and distributed system failures without needing complex mathematical tools.

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

When Should You Use Liquid Clustering? Benchmarking Lakehouse Layout Strategies

Physical data layout is one of the most consequential decisions in lakehouse engineering. The author compares Liquid Clustering, ZOrdering, and partitioning across four workload types on Delta Lake, uncovering two undocumented failure modes that likely affect production systems today and offering a decision framework for choosing the right layout strategy.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

The Minimum Viable Manager: Building Trust, Feedback, and Alignment

In this podcast, Shane Hastie, Lead Editor for Culture & Methods, spoke to Matt Gjertsen, founder of Built and author of Minimum Viable Manager, about the three foundational skills every first-time manager needs, how to build trust and give effective feedback, and why human leadership skills matter even more in the age of AI.

All in culture-methods

DevOps

Featured in DevOps

Building Resilient Platforms: Insights from 20+ Years in Mission-Critical Infrastructure

Matthew Liste explains the 12 core principles of building scalable, reliable platforms for enterprise tech teams. From avoiding technical debt and managing deprecation to building a strong engineering culture, Liste discusses how to design infrastructure platforms that reduce complexity, streamline developer workflows, and deliver long-term value for senior architects and engineering leaders.

All in devops

Events

Helpful links

Choose your language

Architect Certification

Distributed systems, decentralized decisions, platform engineering, and AI architecture.
Online. Register Now.

AI-Assisted Engineering Certification

Your coding agent moves fast. Who checks whether it's making the codebase better?
Online. Register Now.

AI Security & Privacy Engineering Certification

Secure and govern production AI systems, from sensitive data to guardrails, evals, and audits.
Online. Register now.

High-Performing Teams Certification

Compare team design, delivery flow, AI roles, and metrics with experienced practitioners.
Online. Register Now.

QCon San Francisco

What's working across AI, architecture, and leadership, from the teams doing it.
Register. Early bird ends Nov 10.

QCon AI New York

Production AI across agents, context, evals, security, and infrastructure, from the senior engineers building it.
Register. Early bird ends Nov 10.

QCon London

What early-adopter teams have proven in production, across 15 engineering tracks.
Register. Early bird ends Nov 10.

QCon AI Boston

Learn from the decisions and trade-offs behind AI systems already running in production.
Registration open.

InfoQ Homepage Interviews Ville Tuulos on Big Data and Map/Reduce in Erlang and Python with Disco

Ville Tuulos on Big Data and Map/Reduce in Erlang and Python with Disco

Download

16:28

Bio

Ville Tuulos is a researcher with Nokia Research in Palo Alto and has been working with large data sets since 1999, building solutions for statistical information retrieval. He started Disco, an Erlang/Python implementation of the Map/Reduce framework for distributed computing, now used by Nokia and others for prototyping of data-intensive software with hundreds of gigabytes of real-world data.

About the conference

The Erlang Factory is an event that focuses on Erlang - the computer language that was designed to support distributed, fault-tolerant, soft-realtime applications with requirements for high availability and high concurrency. The main part of the Factory is the conference - a two-day collection of focused subject tracks with an enormous opportunity to meet the best minds in Erlang and network with experts in all its uses and applications.

Jun 24, 2011

Interview with

Ville Tuulos

by

Sadek Drobi

BT