Explanation & Argumentation
Computational Argumentation and Cognition
Dietz, Emmanuelle, Kakas, Antonis, Michael, Loizos
This paper examines the interdisciplinary research question of how to integrate Computational Argumentation, as studied in AI, with Cognition, as can be found in Cognitive Science, Linguistics, and Philosophy. It stems from the work of the 1st Workshop on Computational Argumentation and Cognition (COGNITAR), which was organized as part of the 24th European Conference on Artificial Intelligence (ECAI), and took place virtually on September 8th, 2020. The paper begins with a brief presentation of the scientific motivation for the integration of Computational Argumentation and Cognition, arguing that within the context of Human-Centric AI the use of theory and methods from Computational Argumentation for the study of Cognition can be a promising avenue to pursue. A short summary of each of the workshop presentations is given showing the wide spectrum of problems where the synthesis of the theory and methods of Computational Argumentation with other approaches that study Cognition can be applied. The paper presents the main problems and challenges in the area that would need to be addressed, both at the scientific level but also at the epistemological level, particularly in relation to the synthesis of ideas and approaches from the various disciplines involved.
Explainability and the Fourth AI Revolution
Contributed chapter to "HANDBOOK OF RESEARCH ON ARTIFICIAL INTELLIGENCE, INNOVATION AND ENTREPRENEURSHIP" to be published by Edward Elgar Publishing Loizos Michael Abstract: This chapter discusses AI from the prism of an automated process for the organization of data, and exemplifies the role that explainability has to play in moving from the current generation of AI systems to the next one, where the role of humans is lifted from that of data annotators working for the AI systems to that of collaborators working with the AI systems. Keywords: data organization, automation, explainability, fourth AI revolution, learning, XIXO principle, machine coaching Acknowledgements: This work was supported by funding from the EU's Horizon 2020 Research and Innovation Programme under grant agreements no. Explainable automated organization of data. Although admittedly not a comprehensive definition of the wide scope of Artificial Intelligence (AI), this phrase does capture how AI has come to be ...
Judge denies L.A. police union's request to block vaccine mandate
A judge on Wednesday denied a request by the Los Angeles police union that he block the city's COVID-19 vaccination mandate for police officers from taking effect. Having rejected the Police Protective League's petition for a temporary restraining order, California Superior Court Judge Mitchell L. Beckloff must still rule on a related request for a preliminary injunction, which would halt the mandate for officers while a lawsuit the union filed against the city over the rollout of the vaccine requirement goes forward. A court hearing on the injunction is scheduled for next month. The judge did not explain the reasoning for his decision in court records available online Thursday. Under the city's mandate, all city employees including police officers are required to be fully vaccinated by Dec. 18 unless they are granted a medical or religious exemption, and agree in the run-up to the deadline to submit to regular coronavirus testing if they are unvaccinated.
The Importance of Explainable AI - Insurance Thought Leadership
Explainable AI can help decision-makers in insurance understand the rationale and logic behind AI and machine learning results. "Most businesses believe that machine learning models are opaque and non-intuitive and no information is provided regarding their decision-making and predictions," -- Swathi Young, host at Women in AI. Explainable AI is evolving to give meaning to artificial intelligence and machine learning in insurance. The XAI (explainable AI) model has the key factors, which are explained in the passed and not passed cases. The features that are extracted from the insurance customer profile and the accident image are highlighted in the XAI model.
Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities
Saeed, Waddah, Omlin, Christian
The past decade has seen significant progress in artificial intelligence (AI), which has resulted in algorithms being adopted for resolving a variety of problems. However, this success has been met by increasing model complexity and employing black-box AI models that lack transparency. In response to this need, Explainable AI (XAI) has been proposed to make AI more transparent and thus advance the adoption of AI in critical domains. Although there are several reviews of XAI topics in the literature that identified challenges and potential research directions in XAI, these challenges and research directions are scattered. This study, hence, presents a systematic meta-survey for challenges and future research directions in XAI organized in two themes: (1) general challenges and research directions in XAI and (2) challenges and research directions in XAI based on machine learning life cycle's phases: design, development, and deployment. We believe that our meta-survey contributes to XAI literature by providing a guide for future exploration in the XAI area.
Counterfactual Explanations for Models of Code
Cito, Jürgen, Dillig, Isil, Murali, Vijayaraghavan, Chandra, Satish
Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model came to a certain conclusion and how to act upon the model's prediction. Motivated by this problem, this paper explores counterfactual explanations for models of source code. Such counterfactual explanations constitute minimal changes to the source code under which the model "changes its mind". We integrate counterfactual explanation generation to models of source code in a real-world setting. We describe considerations that impact both the ability to find realistic and plausible counterfactual explanations, as well as the usefulness of such explanation to the user of the model. In a series of experiments we investigate the efficacy of our approach on three different models, each based on a BERT-like architecture operating over source code.
Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification models
Amoukou, Salim I., Brunel, Nicolas J. B
To explain the decision of any model, we extend the notion of probabilistic Sufficient Explanations (P-SE). For each instance, this approach selects the minimal subset of features that is sufficient to yield the same prediction with high probability, while removing other features. The crux of P-SE is to compute the conditional probability of maintaining the same prediction. Therefore, we introduce an accurate and fast estimator of this probability via random Forests for any data $(\boldsymbol{X}, Y)$ and show its efficiency through a theoretical analysis of its consistency. As a consequence, we extend the P-SE to regression problems. In addition, we deal with non-binary features, without learning the distribution of $X$ nor having the model for making predictions. Finally, we introduce local rule-based explanations for regression/classification based on the P-SE and compare our approaches w.r.t other explainable AI methods. These methods are publicly available as a Python package at \url{www.github.com/salimamoukou/acv00}.
"How Does It Detect A Malicious App?" Explaining the Predictions of AI-based Android Malware Detector
Lu, Zhi, Thing, Vrizlynn L. L.
AI methods have been proven to yield impressive performance on Android malware detection. However, most AI-based methods make predictions of suspicious samples in a black-box manner without transparency on models' inference. The expectation on models' explainability and transparency by cyber security and AI practitioners to assure the trustworthiness increases. In this article, we present a novel model-agnostic explanation method for AI models applied for Android malware detection. Our proposed method identifies and quantifies the data features relevance to the predictions by two steps: i) data perturbation that generates the synthetic data by manipulating features' values; and ii) optimization of features attribution values to seek significant changes of prediction scores on the perturbed data with minimal feature values changes. The proposed method is validated by three experiments. We firstly demonstrate that our proposed model explanation method can aid in discovering how AI models are evaded by adversarial samples quantitatively. In the following experiments, we compare the explainability and fidelity of our proposed method with state-of-the-arts, respectively.
Characterizing Human Explanation Strategies to Inform the Design of Explainable AI for Building Damage Assessment
Shin, Donghoon, Grover, Sachin, Holstein, Kenneth, Perer, Adam
Explainable AI (XAI) is a promising means of supporting human-AI collaborations for high-stakes visual detection tasks, such as damage detection tasks from satellite imageries, as fully-automated approaches are unlikely to be perfectly safe and reliable. However, most existing XAI techniques are not informed by the understandings of task-specific needs of humans for explanations. Thus, we took a first step toward understanding what forms of XAI humans require in damage detection tasks. We conducted an online crowdsourced study to understand how people explain their own assessments, when evaluating the severity of building damage based on satellite imagery. Through the study with 60 crowdworkers, we surfaced six major strategies that humans utilize to explain their visual damage assessments. We present implications of our findings for the design of XAI methods for such visual detection contexts, and discuss opportunities for future research.
A Survey on the Robustness of Feature Importance and Counterfactual Explanations
Mishra, Saumitra, Dutta, Sanghamitra, Long, Jason, Magazzeni, Daniele
There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour for individual instances. Several methods have been proposed for local analysis, but relatively lesser effort has gone into understanding if the explanations are robust and accurately reflect the behaviour of underlying models. In this work, we present a survey of the works that analysed the robustness of two classes of local explanations (feature importance and counterfactual explanations) that are popularly used in analysing AI/ML models in finance. The survey aims to unify existing definitions of robustness, introduces a taxonomy to classify different robustness approaches, and discusses some interesting results. Finally, the survey introduces some pointers about extending current robustness analysis approaches so as to identify reliable explainability methods.