InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
/articles/storage-cloud-apache-bookkeeper/en/smallimage/logo-1619468572224.jpg)
Indestructible Storage in the Cloud with Apache Bookkeeper
At Salesforce, we required a storage system that could work with two kinds of streams, one stream for write-ahead logs and one for data. But we have competing requirements from both of the streams. Being the pioneers in cloud computing, we also required our storage system to be cloud-aware as the requirements of availability and durability are ever more increasing.
-
/articles/digital-twin-predictive-maintenance/en/smallimage/digital-twins-and-predictive-maintenance-small-1615196054131.jpg)
The Perfect Pair: Digital Twins and Predictive Maintenance
Businesses are moving towards developing a predictive maintenance model using digital twins that mirror their real-life counterparts. In this article, the author looks at digital twins, and provides an example of how to build one.
-
/articles/optimizing-mlops-enterprise-ai/en/smallimage/how-optimizing-MLOps-can-revolutionize-enterprise-AI-logo-small-1614873793830.jpg)
How Optimizing MLOps Can Revolutionize Enterprise AI
In this article, author Monte Zweben discusses data science architecture, containerization, and how new solutions like Feature Store can help with the full lifecycle of machine learning processes.
-
/articles/machine-learning-agile/en/smallimage/agile-development-applied-to-machine-learning-projects-logo-small-1614095337754.jpg)
Agile Development Applied to Machine Learning Projects
Machine learning is a powerful new tool, but how does it fit in your agile development? Developing ML with agile has a few challenges that new teams coming up in the space need to be prepared for - from new roles like data scientists to concerns in reproducibility and dependency management.
-
/articles/saga-orchestration-outbox/en/smallimage/logo-1614119945335.jpg)
Saga Orchestration for Microservices Using the Outbox Pattern
The outbox pattern, implemented via change data capture, is a proven approach for addressing the concern of data exchange between microservices. The saga pattern, as demonstrated in this article, is useful for data updates that span multiple microservices.
-
/articles/data-visualizations-python-bokeh/en/smallimage/logo-1613733725556.jpg)
How to Build Interactive Data Visualizations for Python with Bokeh
In this article, the author shows how to use one of the powerful Python tools Bokeh in creating data visualizations with custom charts.
-
/articles/future-data-engineering-riccomini/en/smallimage/the-future-of-data-engineering-logo-small-1613120173588.jpg)
The Future of Data Engineering
Chris Riccomini examines the current and future states of the art in data pipelines, data streaming, and data warehousing. He presents a six-stage evolution that data ecosystems follow, from a simple monolith to a complex data-microwarehouse architecture as the data engineers who manage them solve problems and clarify their roles as infrastructure engineers, rather than data stewards.
-
/articles/evolution-precomputation-technology-data-analytics/en/smallimage/the-evolutionof-precomputation-technology-small-1612883163091.jpg)
The Evolution of Precomputation Technology and its Role in Data Analytics
In this article, author Yang Li discusses the importance of precomputation techniques in databases, OLAP and data cubes, and some of the trends in using precomputation in big data analytics.
-
/articles/hive-performance-tuning-techniques/en/smallimage/data-table-s-1612367270351.jpeg)
Performance Tuning Techniques of Hive Big Data Table
In this article, author Sudhish Koloth discusses how to tackle performance problems when using Hive Big Data tables.
-
/articles/microprofile-microservices/en/smallimage/microprofile-logo-small-1612176632505.jpg)
Virtual Panel: the MicroProfile Influence on Microservices Frameworks
In mid-2016, the MicroProfile initiative was created as a collaboration of vendors to deliver microservices for enterprise Java. InfoQ recently asked the opinion of expert practitioners on how MicroProfile has influenced how developers today are building microservices-based applications, the emergence of new microservices frameworks and reverting back to monolith-based applications development.
-
/articles/ai-cloud-security/en/smallimage/AI-no-silver-bullet-for-cloud-security-small-1611928293687.jpg)
AI No Silver Bullet for Cloud Security, But Here’s How It Can Help
In this article, the author looks at the real role of artificial intelligence in cloud security – the hype, the reality, and how we can resolve the gap between them. He encourages the reader to focus on making cloud security platforms that allow humans to provide truly intelligent threat responses, rather than relying on the machines to do it for us.
-
/articles/AI-applied-architecture-decision-optimization/en/smallimage/deploying-ai-in-the-enterprise-small-1611925224285.jpg)
AI Applied in Enterprises: Information Architecture, Decision Optimization, and Operationalization
The book Deploying AI in the Enterprise by Eberhard Hechler, Martin Oberhofer, and Thomas Schaeck gives insight into the current state of AI related to themes like change management, DevOps, risk management, blockchain, and information governance. It discusses the possibilities, limitations, and challenges of AI and provides cases that show how AI is being applied.