Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ


Choose your language

InfoQ Homepage News AWS and Microsoft Working Together on PyWhy, the New Home of Causal ML Library DoWhy

AWS and Microsoft Working Together on PyWhy, the New Home of Causal ML Library DoWhy

AWS in a joint effort with Microsoft have established PyWhy as a fresh GitHub organization to integrate AWS algorithms into DoWhy, a causal ML library from Microsoft, which has moved to PyWhy.

The mission of PyWhy is to build an open-source ecosystem for causal machine learning that advances the state of the art and makes it available to practitioners and researchers. PyWhy, will build and host interoperable libraries, tools, and other resources spanning a variety of causal tasks and applications, connected through a common API on foundational causal operations and a focus on the end-to-end analysis process.

The majority of real-world systems, whether they be industrial procedures, supply chain systems, or distributed computer systems, may be characterized using variables that may or may not have a causal relationship with one another.

The evaluation of causal machine learning models and the formalization and integration of domain knowledge into machine learning pipelines present significant research problems. Finding the best identification technique, creating an estimator, and performing robustness checks are all phases that are often completed entirely from scratch as part of the normal procedure. The assumptions were difficult to comprehend and validate, though.

DoWhy is one of the existing causality libraries that focuses on several methods of effect estimation, with the overall objective of determining the impact of interventions on a target variable.

By utilizing the strength of graphical causal models, AWS work enhances DoWhy's current feature set GCMs. Judea Pearl, who won the Turing Award, created the formal framework known as GCMs to model the causal links between variables in a system. The causal diagrams, which visually depict the cause-effect linkages among the observed variables with an arrow from a cause to its effect, are a crucial component of GCMs.

DoWhy already integrates possible outcomes and graphical causal models, two of the most well-liked scientific frameworks for causal inference, into a single library for effect estimates. AWS contribution seeks to strengthen the relationship between the frameworks and the communities of researchers who are committed to them.

About the Author

Rate this Article