Explanation & Argumentation
Interaction Design for Explainable AI: Workshop Proceedings
Madumal, Prashan, Singh, Ronal, Newn, Joshua, Vetere, Frank
As artificial intelligence (AI) systems become increasingly complex and ubiquitous, these systems will be responsible for making decisions that directly affect individuals and society as a whole. Such decisions will need to be justified due to ethical concerns as well as trust, but achieving this has become difficult due to the `black-box' nature many AI models have adopted. Explainable AI (XAI) can potentially address this problem by explaining its actions, decisions and behaviours of the system to users. However, much research in XAI is done in a vacuum using only the researchers' intuition of what constitutes a `good' explanation while ignoring the interaction and the human aspect. This workshop invites researchers in the HCI community and related fields to have a discourse about human-centred approaches to XAI rooted in interaction and to shed light and spark discussion on interaction design challenges in XAI.
Representation, Justification and Explanation in a Value Driven Agent: An Argumentation-Based Approach
Liao, Beishui, Anderson, Michael, Anderson, Susan Leigh
For an autonomous system, the ability to justify and explain its decision making is crucial to improve its transparency and trustworthiness. This paper proposes an argumentation-based approach to represent, justify and explain the decision making of a value driven agent (VDA). By using a newly defined formal language, some implicit knowledge of a VDA is made explicit. The selection of an action in each situation is justified by constructing and comparing arguments supporting different actions. In terms of a constructed argumentation framework and its extensions, the reasons for explaining an action are defined in terms of the arguments for or against the action, by exploiting their defeat relation, as well as their premises and conclusions.
Metrics for Explainable AI: Challenges and Prospects
Hoffman, Robert R., Mueller, Shane T., Klein, Gary, Litman, Jordan
The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we know that an explanainable AI system (XAI) is any good? Our focus is on the key concepts of measurement. We discuss specific methods for evaluating: (1) the goodness of explanations, (2) whether users are satisfied by explanations, (3) how well users understand the AI systems, (4) how curiosity motivates the search for explanations, (5) whether the user's trust and reliance on the AI are appropriate, and finally, (6) how the human-XAI work system performs. The recommendations we present derive from our integration of extensive research literatures and our own psychometric evaluations.
A Tutorial for Weighted Bipolar Argumentation with Continuous Dynamical Systems and the Java Library Attractor
Weighted bipolar argumentation frameworks allow modeling decision problems and online discussions by defining arguments and their relationships. The strength of arguments can be computed based on an initial weight and the strength of attacking and supporting arguments. While previous approaches assumed an acyclic argumentation graph and successively set arguments' strength based on the strength of their parents, recently continuous dynamical systems have been proposed as an alternative. Continuous models update arguments' strength simultaneously and continuously. While there are currently no analytical guarantees for convergence in general graphs, experiments show that continuous models can converge quickly in large cyclic graphs with thousands of arguments. Here, we focus on the high-level ideas of this approach and explain key results and applications. We also introduce Attractor, a Java library that can be used to solve weighted bipolar argumentation problems. Attractor contains implementations of several discrete and continuous models and numerical algorithms to compute solutions. It also provides base classes that can be used to implement, to evaluate and to compare continuous models easily.
An Interpretable Model with Globally Consistent Explanations for Credit Risk
Chen, Chaofan, Lin, Kangcheng, Rudin, Cynthia, Shaposhnik, Yaron, Wang, Sijia, Wang, Tong
We propose a possible solution to a public challenge posed by the Fair Isaac Corporation (FICO), which is to provide an explainable model for credit risk assessment. Rather than present a black box model and explain it afterwards, we provide a globally interpretable model that is as accurate as other neural networks. Our "two-layer additive risk model" is decomposable into subscales, where each node in the second layer represents a meaningful subscale, and all of the nonlinearities are transparent. We provide three types of explanations that are simpler than, but consistent with, the global model. One of these explanation methods involves solving a minimum set cover problem to find high-support globally-consistent explanations. We present a new online visualization tool to allow users to explore the global model and its explanations.
A Polynomial-time Fragment of Epistemic Probabilistic Argumentation (Technical Report)
Probabilistic argumentation allows reasoning about argumentation problems in a way that is well-founded by probability theory. However, in practice, this approach can be severely limited by the fact that probabilities are defined by adding an exponential number of terms. We show that this exponential blowup can be avoided in an interesting fragment of epistemic probabilistic argumentation and that some computational problems that have been considered intractable can be solved in polynomial time. We give efficient convex programming formulations for these problems and explore how far our fragment can be extended without loosing tractability.
Counting Complexity for Reasoning in Abstract Argumentation
Fichte, Johannes K., Hecher, Markus, Meier, Arne
In this paper, we consider counting and projected model counting of extensions in abstract argumentation for various semantics. When asking for projected counts we are interested in counting the number of extensions of a given argumentation framework while multiple extensions that are identical when restricted to the projected arguments count as only one projected extension. We establish classical complexity results and parameterized complexity results when the problems are parameterized by treewidth of the undirected argumentation graph. To obtain upper bounds for counting projected extensions, we introduce novel algorithms that exploit small treewidth of the undirected argumentation graph of the input instance by dynamic programming (DP). Our algorithms run in time double or triple exponential in the treewidth depending on the considered semantics. Finally, we take the exponential time hypothesis (ETH) into account and establish lower bounds of bounded treewidth algorithms for counting extensions and projected extension.
Optimization of Information-Seeking Dialogue Strategy for Argumentation-Based Dialogue System
Katsumi, Hisao, Hiraoka, Takuya, Yoshino, Koichiro, Yamamoto, Kazeto, Motoura, Shota, Sadamasa, Kunihiko, Nakamura, Satoshi
Argumentation-based dialogue systems, which can handle and exchange arguments through dialogue, have been widely researched. It is required that these systems have sufficient supporting information to argue their claims rationally; however, the systems often do not have enough of such information in realistic situations. One way to fill in the gap is acquiring such missing information from dialogue partners (information-seeking dialogue). Existing information-seeking dialogue systems are based on handcrafted dialogue strategies that exhaustively examine missing information. However, the proposed strategies are not specialized in collecting information for constructing rational arguments. Moreover, the number of system's inquiry candidates grows in accordance with the size of the argument set that the system deal with. In this paper, we formalize the process of information-seeking dialogue as Markov decision processes (MDPs) and apply deep reinforcement learning (DRL) for automatically optimizing a dialogue strategy. By utilizing DRL, our dialogue strategy can successfully minimize objective functions, the number of turns it takes for our system to collect necessary information in a dialogue. We conducted dialogue experiments using two datasets from different domains of argumentative dialogue. Experimental results show that the proposed formalization based on MDP works well, and the policy optimized by DRL outperformed existing heuristic dialogue strategies.
Explainable AI won't deliver. Here's why. – Cassie Kozyrkov – Medium
Explainable AI (XAI) is getting a lot of attention these days, but it won't deliver the basis for trust you're hoping for. Before we get caught up in the hype, let's examine the wisdom of a sentence I've been hearing a lot lately: "in order to trust AI, we need it to be able to explain how it made its decisions." There are two ways that we can communicate what we want when programming a computer, we can either give explicit instructions -- handcrafted code -- where we tell the computer how to convert the input into the output… or we can say, "Here, look at a bunch of examples and figure it out." That second one is the essence of artificial intelligence: explaining our wishes with data rather than instructions.
Chemical arms team to assign blame for Syrian attacks despite Russia, Iran opposition
THE HAGUE, NETHERLANDS – The global chemical weapons watchdog will in February begin to assign blame for attacks with banned munitions in Syria's war, using new powers approved by member states but opposed by Damascus and its key allies Russia and Iran. The agency was handed the new task in response to an upsurge in the use of chemical weapons in recent years, notably in the Syrian conflict, where scores of attacks with sarin and chlorine have been carried out by Syrian forces and rebel groups, according to a joint United Nations-OPCW investigation. A core team of 10 experts charged with apportioning blame for poison gas attacks in Syria will be hired soon, Fernando Arias, the new head of the Organisation for the Prohibition of Chemical Weapons (OPCW), told the Foreign Press Association of the Netherlands on Tuesday. The Syria team will be able to look into all attacks previously investigated by the OPCW, dating back to 2014. The OPCW was granted additional powers to identify individuals and institutions responsible for attacks by its 193 member states at a special session in June.