InfoQ Homepage Machine Learning Content on InfoQ
-
/articles/why-ml-projects-fail-production/en/smallimage/why-ml-projects-fail-production-thumbnail-1769072877092.jpg)
Why Most Machine Learning Projects Fail to Reach Production
In this article, the author diagnoses common failures in ML initiatives, including weak problem framing and the persistent prototype-to-production gap. The piece provides practical, experience-based guidance on setting clear business goals, treating data as a product, and aligning cross-functional teams for reliable, production-ready ML delivery.
-
/articles/agent-reinforcement-learning-apache-spark/en/smallimage/thumbnail-1769431334097.jpg)
Autonomous Big Data Optimization: Multi-Agent Reinforcement Learning to Achieve Self-Tuning Apache Spark
This article introduces a reinforcement learning (RL) approach grounded in Apache Spark that enables distributed computing systems to learn optimal configurations autonomously, much like an apprentice engineer who learns by doing. The author also implements a lightweight agent as a driver-side component that uses RL to choose configuration settings before a job runs.
-
/articles/ai-assisted-development-series/en/smallimage/ai-assisted-development-thumb-image-1768388299998.jpg)
Article Series: AI-Assisted Development: Real World Patterns, Pitfalls, and Production Readiness
In this series, we examine what happens after the proof of concept and how AI becomes part of the software delivery pipeline. As AI transitions from proof of concept to production, teams are discovering that the challenge extends beyond model performance to include architecture, process, and accountability. This transition is redefining what constitutes good software engineering.
-
/articles/training-data-preprocessing-for-text-to-video-models/en/smallimage/training-data-preprocessing-for-text-to-video-models-thumbnail-1762244675850.jpg)
Training Data Preprocessing for Text-to-Video Models
In this article, author Aleksandr Rezanov discusses the data preparation for generative text-to-image models to accelerate work on video generation services to be used in TV series and films. He explains how data is prepared and can serve as a starting point for creating custom datasets to develop proprietary models.
-
/articles/ai-ml-data-engineering-trends-2025/en/smallimage/the-infoq-trends-report-500x500-logo-1758095546194.jpeg)
InfoQ AI, ML and Data Engineering Trends Report - 2025
This InfoQ Trends Report offers readers a comprehensive overview of emerging trends and technologies in the areas of AI, ML, and Data Engineering. This report summarizes the InfoQ editorial team’s and external guests' view on the current trends in AI and ML technologies and what to look out for in the next 12 months.
-
/articles/causal-reasoning-observability/en/smallimage/causal-reasoning-observability-thumbnail-1756372623637.jpg)
How Causal Reasoning Addresses the Limitations of LLMs in Observability
Large language models excel at converting observability telemetry into clear summaries but struggle with accurate root cause analysis in distributed systems. LLMs often hallucinate explanations and confuse symptoms with causes. This article suggests how causal reasoning models with Bayesian inference offer more reliable incident diagnosis.
-
/articles/mcp-connector-for-building-smarter-modular-ai-agents/en/smallimage/mcp-connector-for-building-smarter-modular-ai-agents-thumbnail-1756277862571.jpg)
MCP: the Universal Connector for Building Smarter, Modular AI Agents
In this article, the authors discuss Model Context Protocol (MCP), an open standard designed to connect AI agents with tools and data they need. They also talk about how MCP empowers agent development, and its adoption in leading open-source frameworks.
-
/articles/ai-infrastructure-aggregating-agentic-traffic/en/smallimage/ai-infrastructure-aggregating-agentic-traffic-thumbnail-1755682463373.jpg)
The Missing Layer in AI Infrastructure: Aggregating Agentic Traffic
In this article, author Eyal Solomon discusses AI Gateways, the outbound proxy servers that intercept and manage AI-agent-initiated traffic in real time to enforce policies and provide central management.
-
/articles/personalized-content-pagination-prefetching/en/smallimage/personalized-content-pagination-prefetching-thumbnail-1748248589509.jpg)
Faster, Smoother, More Engaging: Personalized Content Pagination
Dynamic content loading powered by AI transforms user experiences by personalizing delivery based on user's behavior and network conditions. By analyzing scroll depth, speed, and dwell time, we optimize loading times, enhance engagement, and reduce infrastructure costs, especially on devices with poor internet connectivity.
-
/articles/practical-design-patterns-modern-ai-systems/en/smallimage/practical-design-patterns-modern-ai-systems-thumbnail-1747122253617.jpg)
Beyond the Gang of Four: Practical Design Patterns for Modern AI Systems
In this article, author Rahul Suresh discusses emerging AI patterns in the areas of prompting, responsible AI, user experience, AI-Ops, and optimization, with code examples for each design pattern.
-
/articles/best-practices-energy-efficient-ai-ml-systems/en/smallimage/best-practices-energy-efficient-ai-ml-systems-thumbnail-1746711047911.jpg)
Best Practices to Build Energy-Efficient AI/ML Systems
In this article, author Lakshmithejaswi Narasannagari discusses the sustainable innovations in AI/ML technologies, how to track carbon footprint in all stages of ML systems lifecycle and best practices for model development and deployment.
-
/articles/building-observable-machine-learning-systems/en/smallimage/beyond-notebook-thumbnail-1741852201404.jpg)
Beyond Notebook: Building Observable Machine Learning Systems
In this article, the author discusses a machine learning pipeline with observability built-in for credit card fraud detection use case, with tools like MLflow, FastAPI, Streamlit, Apache Kafka, Prometheus, Grafana, and Evidently AI.