InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
/articles/distributed-data-pipelines-apache-airflow/en/smallimage/distributed-data-pipelines-apache-airflow-s-1600719418020.jpeg)
Scalable Cloud Environment for Distributed Data Pipelines with Apache Airflow
In this article, author Lena Hall discusses how to use Apache Airflow to define and execute distributed data pipelines with an example of the workflow framework running on Kubernetes on Azure cloud platform.
-
/articles/explainable-ai-xai/en/smallimage/ai-ml-logo-1600268138146.jpeg)
The Case for Explainable AI (XAI)
Artificial Neural Networks offer significant performance benefits compared to other methodologies, but often at the expense of interpretability. Black box algorithms have precipitated a number of high-profile controversies arising from the inability to understand their inner workings. The efforts seeking to provide more transparency in this regard is referred to as Explainable AI (XAI).
-
/articles/federated-machine-learning/en/smallimage/Figure-3-logo-1599498665208.jpeg)
Federated Machine Learning for Loan Risk Prediction
In this article, author Brendon Machado discusses how data owners and data scientists can work together to create models on privatized data using the federated learning technique and shows how to use it in loan risk prediction use cases.
-
/articles/logistic-regression-model-with-delta-p-statistics/en/smallimage/LOGISTIC-s-1597871025084.jpg)
Easy Interpretation of a Logistic Regression Model with Delta-p Statistics
Delta-p statistics is an easier means of communicating results to a non-technical audience than the plain coefficients of a logistic regression model. In this article, authors Maarit Widmann and Alfredo Roccato discuss how to predict credit eligibility using the Delta-p statistics based solution.
-
/articles/dataops-devops-scale-speed/en/smallimage/combining-dataops-devops-scale-at-speed-logo-small-1597065920955.jpg)
Combining DataOps and DevOps: Scale at Speed
DataOps is an extension of DevOps standards and processes into the data analytics world. It's about streamlining the processes involved in processing, analyzing and deriving value from big data.
-
/articles/gpt3-enabled-applications/en/smallimage/first-wave-GPT-3-enabled-applications-logo-small-1597055494711.jpg)
The First Wave of GPT-3 Enabled Applications Offer a Preview of Our AI Future
The first wave of GPT-3 powered applications are emerging. After priming of only a few examples, GPT-3 could write essays, answer questions, and even generate computer code! Furthermore, GPT-3 can perform algebraic calculations and language translations despite never being taught such concepts. However, GPT-3 is a black box with unpredictable outcomes. Developers must use it responsively.
-
/articles/state-art-automl/en/smallimage/AI-ML-s-1596111042439.jpeg)
State of the Art in Automated Machine Learning
InfoQ caught up with experts Francesca Lazzeri, machine learning scientist lead at Microsoft; Matthew Tovbin, co-founder of Faros AI; Adrian de Wynter, applied scientist in Alexa AI’s Secure AI Foundations; Leah McGuire, principal member of technical staff at Salesforce; and Marios Michailidis, data scientist at H2O.ai, about the state of the art in automated machine learning (AutoML).
-
/articles/get-hired-machine-learning-engineer/en/smallimage/How-to-become-a-machine-learning-engineer-logo-small-1595838313042.jpg)
How to Get Hired as a Machine Learning Engineer
To become a machine learning engineer, you have to interview. You have to gain relevant skills from books, courses, conferences, and projects. Include technologies, frameworks, and projects on your CV. In an interview, expect that you will be asked technical questions, insight questions, and programming questions. When given a technical task, demonstrate your skills as if you already had the job.
-
/articles/data-leadership-book-review-interview/en/smallimage/Data-leadership-s-1595453339836.jpg)
Data Leadership Book Review and Interview
Data Leadership book, authored by Anthony Algmin, covers the data leadership topic and how data leaders should manage and govern the data management programs in their organizations. Data Leadership is how organizations choose to apply their energy and resources toward creating data capabilities to influence their business.
-
/articles/innovation-startup-agile-culture/en/smallimage/innovation-s-1594939001871.jpg)
Innovation Startups Modeling Agile Culture
Innovation is not only about the most advanced technology; management and processes are the new era of startups' innovation. To mix the power of the data and the importance of people to offer business intelligence is a key point nowadays. The result is not only the most important thing; the way you do it is more important. To be agile is to adapt to today's market.
-
/articles/applied-probability-unstructured-events-theta-sketches/en/smallimage/applied-probability-unstructured-events-theta-sketches-s-1593199758266.jpg)
Applied Probability - Counting Large Set of Unstructured Events with Theta Sketches
In this article, author Ronen Cohen discusses the solution to processing the event data using Theta Sketches and technologies like HBase and Kafka.
-
/articles/tornadovm-java-gpu-fpga/en/smallimage/java-1591918279658.jpeg)
TornadoVM: Accelerating Java with GPUs and FPGAs
The proliferation of heterogeneous hardware represents a problem for programming languages such as Java that target CPUs. TornadoVM extends the Graal JIT compiler to take advantage of GPUs & FPGAs and provides a flexible, high-level model whilst still enabling high performance and features such as live task migration.