Explanation & Argumentation
Government Deep Tech 2022 Top Funding Focus Explainable AI, Photonics, Quantum
DARPA, In-Q-Tel, US National Laboratories (examples: Argonne, Oak Ridge) are famous government funding agencies for deep tech on the forward boundaries, the near impossible, that have globally transformative solutions. The Internet is a prime example where more than 70% of the 7.8 billion population are online in 2022, closing in on 7 hours daily mobile usage, and global wealth of $500 Trillion is powered by the Internet. There is convergence between the early bets led by government funding agencies and the largest corporations and their investments. An example is from 2015, where I was invited to help the top 100 CEOs, representing nearly $100 Trillion in assets under management, to look ten years into the future for their investments. The resulting working groups, and private summits resulted in the member companies investing in all the areas identified: quantum computing, block chain, cybersecurity, big data, privacy and data, AI/ML, future in fintech, financial inclusion, ...
Upol Ehsan on Human-Centered Explainable AI and Social Transparency
Bio: Upol Ehsan cares about people first, technology second. He is a doctoral candidate in the School of Interactive Computing at Georgia Tech and an affiliate at the Data & Society Research Institute. Combining his expertise in AI and background in Philosophy, his work in Explainable AI (XAI) aims to foster a future where anyone, regardless of their background, can use AI-powered technology with dignity. Actively publishing in top peer-reviewed venues like CHI, his work has received multiple awards and been covered in major media outlets. Bridging industry and academia, he serves on multiple program committees in HCI and AI conferences (e.g., DIS, IUI, NeurIPS) and actively connects these communities (e.g, the widely attended HCXAI workshop at CHI).
A Meta Survey of Quality Evaluation Criteria in Explanation Methods
Lรถfstrรถm, Helena, Hammar, Karl, Johansson, Ulf
Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are opaque with low transparency and comprehensibility, explanations are essential for bias detection and control of uncertainty. There are a plethora of criteria to choose from when evaluating explanation method quality. However, since existing criteria focus on evaluating single explanation methods, it is not obvious how to compare the quality of different methods. This lack of consensus creates a critical shortage of rigour in the field, although little is written about comparative evaluations of explanation methods. In this paper, we have conducted a semi-systematic meta-survey over fifteen literature surveys covering the evaluation of explainability to identify existing criteria usable for comparative evaluations of explanation methods. The main contribution in the paper is the suggestion to use appropriate trust as a criterion to measure the outcome of the subjective evaluation criteria and consequently make comparative evaluations possible. We also present a model of explanation quality aspects. In the model, criteria with similar definitions are grouped and related to three identified aspects of quality; model, explanation, and user. We also notice four commonly accepted criteria (groups) in the literature, covering all aspects of explanation quality: Performance, appropriate trust, explanation satisfaction, and fidelity. We suggest the model be used as a chart for comparative evaluations to create more generalisable research in explanation quality.
Concept Embedding Analysis: A Review
Deep neural networks (DNNs) have found their way into many applications with potential impact on the safety, security, and fairness of human-machine-systems. Such require basic understanding and sufficient trust by the users. This motivated the research field of explainable artificial intelligence (XAI), i.e. finding methods for opening the "black-boxes" DNNs represent. For the computer vision domain in specific, practical assessment of DNNs requires a globally valid association of human interpretable concepts with internals of the model. The research field of concept (embedding) analysis (CA) tackles this problem: CA aims to find global, assessable associations of humanly interpretable semantic concepts (e.g., eye, bearded) with internal representations of a DNN. This work establishes a general definition of CA and a taxonomy for CA methods, uniting several ideas from literature. That allows to easily position and compare CA approaches. Guided by the defined notions, the current state-of-the-art research regarding CA methods and interesting applications are reviewed. More than thirty relevant methods are discussed, compared, and categorized. Finally, for practitioners, a survey of fifteen datasets is provided that have been used for supervised concept analysis. Open challenges and research directions are pointed out at the end.
Explainable AI
Advances in AI, especially based on machine learning, have provided a powerful way to extract useful patterns from large, heterogeneous data sources. The rise in massive amounts of data, coupled with powerful computing capabilities, makes it possible to tackle previously intractable real-world problems. Medicine, business, government, and science are rapidly automating decisions and processes using machine learning. Unlike traditional AI approaches based on explicit rules expressing domain knowledge, machine learning often lacks explicit human-understandable specification of the rules producing model outputs. With growing reliance on automated decisions, an overriding concern is understanding the process by which "black box" AI techniques make decisions.
Explainable AI can improve hospice care, reduce costs
Hospice is a compassionate approach focusing on quality of life for terminally ill patients and their caregivers, with approximately 1.55 million Medicare beneficiaries enrolled in hospice care for at least one day during 2018 โ 17% more than in 2014. However, at least 14% of Medicare beneficiaries enrolled in hospice stayed for more than 180 days, and hospice stays beyond six months can result in substantial excess costs to healthcare organizations under value-based care arrangements. David Klebonis, COO of Palm Beach Accountable Care Organization, has developed highly interpretable machine learning models that, because of the sensitivity of the clinical decision involved, cannot only accurately predict hospice overstays to drive appropriate hospice referrals, but also surface decision criteria that satisfy clinician scrutiny and promote adoption. "Artificial intelligence and machine learning have the potential to use data to predict patients with a high probability of expiring within the next six months, so that physicians can enter into conversations with these patients and their families about the possibility of referral to hospice," he said. Klebonis, who will address the topic this month at HIMSS22, said in Florida about 58% of Medicare decedents were in hospice at the time of death.
Forget Explainable AI! What We Need Now is Understandable AI
As artificial intelligence technologies have gained popularity, creators and users have used and modified a variety of terms and phrases to describe and characterize their work. One may probably have heard terms like "narrow AI", "deep learning", "neural networks", and other new descriptors being used to distinguish between distinct types and roles of AI, different sections of AI solutions, and so on. Another result of the rapid expansion of AI's availability and use has been the demand for "explainable AI," or approaches and procedures that make Artificial Intelligence more accessible to all types of humans. And, while explainable AI is important, it's not really the answer always. The ambition to understand how computers make decisions is admirable, but XAI technologies or approaches will never be sufficient.