Overview
SingularityNET Latest Ecosystem Updates: March 2022
This month has been packed with excitement and progress for the SingularityNET organization and ecosystem. We're happy to share some brief highlights from around our ecosystem. Don't miss it -- the DynaSets open beta is about to start; see this blogpost for all information. SingularityDAO also released their 2022 Roadmap. You can read all five parts of it on their Medium blog page. They shared their plans to launch a wide variety of new DynaSets -- some entirely AI-driven, while others implement advanced shorting & leveraged features and even one community-chosen set.
A Meta Survey of Quality Evaluation Criteria in Explanation Methods
Lรถfstrรถm, Helena, Hammar, Karl, Johansson, Ulf
Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are opaque with low transparency and comprehensibility, explanations are essential for bias detection and control of uncertainty. There are a plethora of criteria to choose from when evaluating explanation method quality. However, since existing criteria focus on evaluating single explanation methods, it is not obvious how to compare the quality of different methods. This lack of consensus creates a critical shortage of rigour in the field, although little is written about comparative evaluations of explanation methods. In this paper, we have conducted a semi-systematic meta-survey over fifteen literature surveys covering the evaluation of explainability to identify existing criteria usable for comparative evaluations of explanation methods. The main contribution in the paper is the suggestion to use appropriate trust as a criterion to measure the outcome of the subjective evaluation criteria and consequently make comparative evaluations possible. We also present a model of explanation quality aspects. In the model, criteria with similar definitions are grouped and related to three identified aspects of quality; model, explanation, and user. We also notice four commonly accepted criteria (groups) in the literature, covering all aspects of explanation quality: Performance, appropriate trust, explanation satisfaction, and fidelity. We suggest the model be used as a chart for comparative evaluations to create more generalisable research in explanation quality.
Concept Embedding Analysis: A Review
Deep neural networks (DNNs) have found their way into many applications with potential impact on the safety, security, and fairness of human-machine-systems. Such require basic understanding and sufficient trust by the users. This motivated the research field of explainable artificial intelligence (XAI), i.e. finding methods for opening the "black-boxes" DNNs represent. For the computer vision domain in specific, practical assessment of DNNs requires a globally valid association of human interpretable concepts with internals of the model. The research field of concept (embedding) analysis (CA) tackles this problem: CA aims to find global, assessable associations of humanly interpretable semantic concepts (e.g., eye, bearded) with internal representations of a DNN. This work establishes a general definition of CA and a taxonomy for CA methods, uniting several ideas from literature. That allows to easily position and compare CA approaches. Guided by the defined notions, the current state-of-the-art research regarding CA methods and interesting applications are reviewed. More than thirty relevant methods are discussed, compared, and categorized. Finally, for practitioners, a survey of fifteen datasets is provided that have been used for supervised concept analysis. Open challenges and research directions are pointed out at the end.
Generalization bounds for learning under graph-dependence: A survey
Zhang, Rui-Ray, Amini, Massih-Reza
Traditional statistical learning theory relies on the assumption that data are identically and independently generated from a given distribution (i.i.d.). The independently distributed assumption, on the other hand, fails to hold in many real applications. In this survey, we consider learning settings in which examples are dependent and their dependence relationship can be characterized by a graph. We collect various graph-dependent concentration bounds, which are then used to derive Rademacher and stability generalization bounds for learning from graph-dependent data. We illustrate this paradigm with three learning tasks and provide some research directions for future work. To the best of our knowledge, this is the first survey on this subject.
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges
Matsubara, Yoshitomo, Levorato, Marco, Restuccia, Francesco
Mobile devices such as smartphones and autonomous vehicles increasingly rely on deep neural networks (DNNs) to execute complex inference tasks such as image classification and speech recognition, among others. However, continuously executing the entire DNN on mobile devices can quickly deplete their battery. Although task offloading to cloud/edge servers may decrease the mobile device's computational burden, erratic patterns in channel quality, network, and edge server load can lead to a significant delay in task execution. Recently, approaches based on split computing (SC) have been proposed, where the DNN is split into a head and a tail model, executed respectively on the mobile device and on the edge server. Ultimately, this may reduce bandwidth usage as well as energy consumption. Another approach, called early exiting (EE), trains models to embed multiple "exits" earlier in the architecture, each providing increasingly higher target accuracy. Therefore, the trade-off between accuracy and delay can be tuned according to the current conditions or application demands. In this paper, we provide a comprehensive survey of the state of the art in SC and EE strategies by presenting a comparison of the most relevant approaches. We conclude the paper by providing a set of compelling research challenges.
Deep Learning for Smart Healthcare--A Survey on Brain Tumor Detection from Medical Imaging
Advances in technology have been able to affect all aspects of human life. For example, the use of technology in medicine has made significant contributions to human society. In this article, we focus on technology assistance for one of the most common and deadly diseases to exist, which is brain tumors. Every year, many people die due to brain tumors; based on โbraintumorโ website estimation in the U.S., about 700,000 people have primary brain tumors, and about 85,000 people are added to this estimation every year. To solve this problem, artificial intelligence has come to the aid of medicine and humans. Magnetic resonance imaging (MRI) is the most common method to diagnose brain tumors. Additionally, MRI is commonly used in medical imaging and image processing to diagnose dissimilarity in different parts of the body. In this study, we conducted a comprehensive review on the existing efforts for applying different types of deep learning methods on the MRI data and determined the existing challenges in the domain followed by potential future directions. One of the branches of deep learning that has been very successful in processing medical images is CNN. Therefore, in this survey, various architectures of CNN were reviewed with a focus on the processing of medical images, especially brain MRI images.
The transformational role of GPU computing and deep learning in drug discovery - Nature Machine Intelligence
Deep learning has disrupted nearly every field of research, including those of direct importance to drug discovery, such as medicinal chemistry and pharmacology. This revolution has largely been attributed to the unprecedented advances in highly parallelizable graphics processing units (GPUs) and the development of GPU-enabled algorithms. In this Review, we present a comprehensive overview of historical trends and recent advances in GPU algorithms and discuss their immediate impact on the discovery of new drugs and drug targets. We also cover the state-of-the-art of deep learning architectures that have found practical applications in both early drug discovery and consequent hit-to-lead optimization stages, including the acceleration of molecular docking, the evaluation of off-target effects and the prediction of pharmacological properties. We conclude by discussing the impacts of GPU acceleration and deep learning models on the global democratization of the field of drug discovery that may lead to efficient exploration of the ever-expanding chemical universe to accelerate the discovery of novel medicines. GPUs, which are highly parallel computer processing units, were originally designed for graphics applications, but they have played an important role in accelerating the development of deep learning methods. In this Review, Pandey and colleagues summarize how GPUs have advanced machine learning in the field of drug discovery.
Survey of Artificial Intelligence - SRI International
Letter to Mr. Denicoff, Office of Navy Research: Proposal to continue work on a survey of the field of artificial intelligence now in progress under ONR Contract N0014-68-C-0266. The end product of the proposed continuation would be a report or reports in which the major techniques and subject matter of Artificial Intelligence are presented and explained in a coherent and logical manner.
European Council introductory handbook on Artificial Intelligence and Human Rights
Turning ethical Artificial Intelligence into reality implies assessing the risks of AI in context, particularly in terms of its impact on civil and social rights and then, depending on the assessed risk, defining standards or regulating the ethical design, development and implementation of algorithmic systems. This is the aim of this introductory handbook by the Council of Europe and the Alan Turing Institute, of late 2021, "Artificial Intelligence, Human Rights, Democracy and the Rule of Law: A Primer". A key initiative in this process was the feasibility study prepared and approved in December by the Council of Europe's Ad Hoc Committee on Artificial Intelligence (CAHAI), which explores options for an international legal response, based on Council of Europe standards in the fields of artificial intelligence, rights, democracy and the rule of law: it proposes nine principles and priorities that are well suited to the new challenges posed by the design, development and deployment of Artificial Intelligence systems. When codified into law, these principles and priorities create a set of interconnected rights and obligations that will work to ensure that the design and use of artificial intelligence technologies conform to the values of human rights, democracy and the rule of law. The key question is whether there are responses to the specific risks and opportunities presented by AI systems that can and should be addressed through the use of binding and non-binding international legal instruments, through the agency of the Council of Europe, which is the guardian of the European Convention on Human Rights, Convention 108, which protects the processing of personal data, and the European Social Charter.