Goto

Collaborating Authors

 Explanation & Argumentation


Army researchers enhance AI critical to Soldier-machine teamwork

#artificialintelligence

Artificial intelligence possesses the capacity to achieve incredible results, but cannot always work alone. Researchers identified two key components in successful human-machine collaboration that may enhance how the U.S. Army will fight in the future. To achieve dominance in what is known as multi-domain operations, warfighters will need a layered intelligence, surveillance and reconnaissance, or ISR, network that maintains a functional relationship between autonomous sensors, human intelligence and friendly special operations forces. Multi-domain operations, known as MDO, is a joint warfighting concept that foresees conflict occurring in multiple domains: land, air, sea, cyber and space. The concept has many nuances, but basically describes how the Army, as part of the joint force, will solve the problem of layered standoff in all domains.


Algorithmic Recourse: from Counterfactual Explanations to Interventions

arXiv.org Artificial Intelligence

As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a favorable decision. Counterfactual explanations -- "how the world would have (had) to be different for a desirable outcome to occur" -- aim to satisfy these criteria. Existing works have primarily focused on designing algorithms to obtain counterfactual explanations for a wide range of settings. However, one of the main objectives of "explanations as a means to help a data-subject act rather than merely understand" has been overlooked. In layman's terms, counterfactual explanations inform an individual where they need to get to, but not how to get there. In this work, we rely on causal reasoning to caution against the use of counterfactual explanations as a recommendable set of actions for recourse. Instead, we propose a shift of paradigm from recourse via nearest counterfactual explanations to recourse through minimal interventions, moving the focus from explanations to recommendations. Finally, we provide the reader with an extensive discussion on how to realistically achieve recourse beyond structural interventions.


PostDoc Researcher - Graph Representation Learning and Explainable AI ai-jobs.net

#artificialintelligence

Accenture Labs Dublin is looking for a Post-Doctoral researcher in the domain of Graph Representation Learning and Explainable AI. You will be in charge of designing interpretable machine learning models to infer knowledge from a graph of clinical, genomic, and behavioural data. Explanations will use a wide range of techniques, such as rules derived from the deep learning models, gradient-based attribution methods, or graph-based explanations based on network analysis. The length of the PostDoc is 3 years. You will join a multi-partner project whose goal is identifying factors that can cause development of new medical conditions, and worsen the quality of life of cancer survivors.


The Emerging Landscape of Explainable AI Planning and Decision Making

arXiv.org Artificial Intelligence

In this paper, we provide a comprehensive outline of the different threads of work in Explainable AI Planning (XAIP) that has emerged as a focus area in the last couple of years and contrast that with earlier efforts in the field in terms of techniques, target users, and delivery mechanisms. We hope that the survey will provide guidance to new researchers in automated planning towards the role of explanations in the effective design of human-in-the-loop systems, as well as provide the established researcher with some perspective on the evolution of the exciting world of explainable planning.


Explainable Artificial Intelligence beyond.ai

#artificialintelligence

Explainable AI cannot be implemented as an afterthought or add-on to an existing system. It must be part of the original design. Beyond Limits systems cover the full spectrum of explainability, providing high-level system alerts, plus drill-down reasoning traces with detailed evidence, probability, and risk. Explainable AI helps take the mystery out of the technology and is the first step in enabling artificial intelligence to work with people in a trusting and mutually beneficial relationship.


Cognitive Argumentation and the Suppression Task

arXiv.org Artificial Intelligence

This paper addresses the challenge of modeling human reasoning, within a new framework called Cognitive Argumentation. This framework rests on the assumption that human logical reasoning is inherently a process of dialectic argumentation and aims to develop a cognitive model for human reasoning that is computational and implementable. To give logical reasoning a human cognitive form the framework relies on cognitive principles, based on empirical and theoretical work in Cognitive Science, to suitably adapt a general and abstract framework of computational argumentation from AI. The approach of Cognitive Argumentation is evaluated with respect to Byrne's suppression task, where the aim is not only to capture the suppression effect between different groups of people but also to account for the variation of reasoning within each group. Two main cognitive principles are particularly important to capture human conditional reasoning that explain the participants' responses: (i) the interpretation of a condition within a conditional as sufficient and/or necessary and (ii) the mode of reasoning either as predictive or explanatory. We argue that Cognitive Argumentation provides a coherent and cognitively adequate model for human conditional reasoning that allows a natural distinction between definite and plausible conclusions, exhibiting the important characteristics of context-sensitive and defeasible reasoning.


The Pragmatic Turn in Explainable Artificial Intelligence (XAI)

arXiv.org Artificial Intelligence

In this paper I argue that the search for explainable models and interpretable decisions in AI must be reformulated in terms of the broader project of offering a pragmatic and naturalistic account of understanding in AI. Intuitively, the purpose of providing an explanation of a model or a decision is to make it understandable to its stakeholders. But without a previous grasp of what it means to say that an agent understands a model or a decision, the explanatory strategies will lack a well-defined goal. Aside from providing a clearer objective for XAI, focusing on understanding also allows us to relax the factivity condition on explanation, which is impossible to fulfill in many machine learning models, and to focus instead on the pragmatic conditions that determine the best fit between a model and the methods and devices deployed to understand it. After an examination of the different types of understanding discussed in the philosophical and psychological literature, I conclude that interpretative or approximation models not only provide the best way to achieve the objectual understanding of a machine learning model, but are also a necessary condition to achieve post-hoc interpretability. This conclusion is partly based on the shortcomings of the purely functionalist approach to post-hoc interpretability that seems to be predominant in most recent literature.


A Modified Perturbed Sampling Method for Local Interpretable Model-agnostic Explanation

arXiv.org Artificial Intelligence

Explainability is a gateway between Artificial Intelligence and society as the current popular deep learning models are generally weak in explaining the reasoning process and prediction results. Local Interpretable Model-agnostic Explanation (LIME) is a recent technique that explains the predictions of any classifier faithfully by learning an interpretable model locally around the prediction. However, the sampling operation in the standard implementation of LIME is defective. Perturbed samples are generated from a uniform distribution, ignoring the complicated correlation between features. This paper proposes a novel Modified Perturbed Sampling operation for LIME (MPS-LIME), which is formalized as the clique set construction problem. In image classification, MPS-LIME converts the superpixel image into an undirected graph. Various experiments show that the MPS-LIME explanation of the black-box model achieves much better performance in terms of understandability, fidelity, and efficiency.


What's In the Box? AI Will Need to Explain its Decisions Before We Can Trust It.

#artificialintelligence

Early last December I found myself back in the job market searching for some temporary seasonal work during the Christmas break from university. My requirements for the role were not demanding: start time preferably post 8 a.m. Other than that I was game for anything. I responded to an online posting for an entry-level retail assistant position in a prominent high street fashion retailer. Without any unreasonable or immodest expectations about getting called for an interview, I began the application process in good faith.


Convex Density Constraints for Computing Plausible Counterfactual Explanations

arXiv.org Artificial Intelligence

The increasing deployment of machine learning as well as legal regulations such as EU's GDPR cause a need for user-friendly explanations of decisions proposed by machine learning models. Counterfactual explanations are considered as one of the most popular techniques to explain a specific decision of a model. While the computation of "arbitrary" counterfactual explanations is well studied, it is still an open research problem how to efficiently compute plausible and feasible counterfactual explanations. We build upon recent work and propose and study a formal definition of plausible counterfactual explanations. In particular, we investigate how to use density estimators for enforcing plausibility and feasibility of counterfactual explanations. For the purpose of efficient computations, we propose convex density constraints that ensure that the resulting counterfactual is located in a region of the data space of high density.