Explanation & Argumentation
Landscape of R packages for eXplainable Artificial Intelligence
Maksymiuk, Szymon, Gosiewska, Alicja, Biecek, Przemyslaw
The growing availability of data and computing power fuels the development of predictive models. In order to ensure the safe and effective functioning of such models, we need methods for exploration, debugging, and validation. New methods and tools for this purpose are being developed within the eXplainable Artificial Intelligence (XAI) subdomain of machine learning. In this work (1) we present the taxonomy of methods for model explanations, (2) we identify and compare 27 packages available in R to perform XAI analysis, (3) we present an example of an application of particular packages, (4) we acknowledge recent trends in XAI. The article is primarily devoted to the tools available in R, but since it is easy to integrate the Python code, we will also show examples for the most popular libraries from Python.
Atish Ray on LinkedIn: Industrialized ML for Governed, Responsible and Explainable AI - Databricks
Accenture research shows full 84% of C-suite executives believe they must leverage Artificial Intelligence (AI) to achieve their growth objectives. Yet 76% acknowledge they struggle when it comes to scaling it across the business. Having the right framework in place for "Industrializing ML" is a key component of scaling AI in the enterprise. Join us for a glimpse into the world of Industrialized ML as it comes to life at Navy Federal Credit Union using Databricks Unified Analytics Platform.
Explainable AI and Design
The most useful and accurate AI models are also more complex, and the more complex a model is, the more challenging it is to comprehend and trust. Why did it make that prediction? AI is not infallible, and it increasingly operates in an opaque way. This severely limits the adoption of advanced AI models in critical settings. The goal of Explainable AI (XAI) is to develop techniques to help users better understand and trust AI models.
Axiom Learning and Belief Tracing for Transparent Decision Making in Robotics
A robot's ability to provide descriptions of its decisions and beliefs promotes effective collaboration with humans. Providing such transparency is particularly challenging in integrated robot systems that include knowledge-based reasoning methods and data-driven learning algorithms. Towards addressing this challenge, our architecture couples the complementary strengths of non-monotonic logical reasoning, deep learning, and decision-tree induction. During reasoning and learning, the architecture enables a robot to provide on-demand relational descriptions of its decisions, beliefs, and the outcomes of hypothetical actions. These capabilities are grounded and evaluated in the context of scene understanding tasks and planning tasks performed using simulated images and images from a physical robot manipulating tabletop objects.
Counterfactual Explanations for Machine Learning: A Review
Verma, Sahil, Dickerson, John, Hines, Keegan
Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of machine learning models is essential to the development of trustworthy machine-learning-based systems. A burgeoning body of research seeks to define the goals and methods of explainability in machine learning. In this paper, we seek to review and categorize research on counterfactual explanations, a specific class of explanation that provides a link between what could have happened had input to a model been changed in a particular way. Modern approaches to counterfactual explainability in machine learning draw connections to the established legal doctrine in many countries, making them appealing to fielded systems in high-impact areas such as finance and healthcare. Thus, we design a rubric with desirable properties of counterfactual explanation algorithms and comprehensively evaluate all currently-proposed algorithms against that rubric. Our rubric provides easy comparison and comprehension of the advantages and disadvantages of different approaches and serves as an introduction to major research themes in this field. We also identify gaps and discuss promising research directions in the space of counterfactual explainability.
Explainable Automated Fact-Checking for Public Health Claims
Kotonya, Neema, Toni, Francesca
Fact-checking is the task of verifying the veracity of claims by assessing their assertions against credible evidence. The vast majority of fact-checking studies focus exclusively on political claims. Very little research explores fact-checking for other topics, specifically subject matters for which expertise is required. We present the first study of explainable fact-checking for claims which require specific expertise. For our case study we choose the setting of public health. To support this case study we construct a new dataset PUBHEALTH of 11.8K claims accompanied by journalist crafted, gold standard explanations (i.e., judgments) to support the fact-check labels for claims. We explore two tasks: veracity prediction and explanation generation. We also define and evaluate, with humans and computationally, three coherence properties of explanation quality. Our results indicate that, by training on in-domain data, gains can be made in explainable, automated fact-checking for claims which require specific expertise.
A collection of recommendable papers and articles on Explainable AI (XAI)
Explainable AI (XAI) refers to methods and techniques in the application of artificial intelligence technology (AI) such that the results of the solution can be understood by humans. It contrasts with the concept of the "black box" in machine learning where even their designers cannot explain why the AI arrived at a specific decision. XAI may be an implementation of the social right to explanation. XAI is relevant even if there is no legal rights or regulatory requirements--for example, XAI can improve the user experience of a product or service by helping end users trust that the AI is making good decisions. The technical challenge of explaining AI decisions is sometimes known as the interpretability problem.
Explainable AI: Making Sense of the Black Box
The Black Square is an iconic painting by Russian artist Kazimir Malevich. The first version was done in 1915. The Black Square continues to impress art historians even today, however it did not impress the then Soviet government and was kept in such poor conditions that it suffered significant cracking and decay. Complex machine learning algorithms can be mathematical work of art, but if these black box algorithms fail to impress and build trust with the users, They might be ignored like Malevich's black square. Dramatic success in machine learning has led to a surge of Artificial Intelligence (AI) applications.
Altruist: Argumentative Explanations through Local Interpretations of Predictive Models
Mollas, Ioannis, Bassiliades, Nick, Tsoumakas, Grigorios
Interpretable machine learning is an emerging field providing solutions on acquiring insights into machine learning models' rationale. It has been put in the map of machine learning by suggesting ways to tackle key ethical and societal issues. However, existing techniques of interpretable machine learning are far from being comprehensible and explainable to the end user. Another key issue in this field is the lack of evaluation and selection criteria, making it difficult for the end user to choose the most appropriate interpretation technique for its use. In this study, we introduce a meta-explanation methodology that will provide truthful interpretations, in terms of feature importance, to the end user through argumentation. At the same time, this methodology can be used as an evaluation or selection tool for multiple interpretation techniques based on feature importance.
Explainable Artificial Intelligence (XAI)
This article was written by Dr. Matt Turek. Dramatic success in machine learning has led to a torrent of Artificial Intelligence (AI) applications. Continued advances promise to produce autonomous systems that will perceive, learn, decide, and act on their own. However, the effectiveness of these systems is limited by the machine's current inability to explain their decisions and actions to human users (Figure 1). The Department of Defense (DoD) is facing challenges that demand more intelligent, autonomous, and symbiotic systems.