Education
Das researching use of artificial intelligence
Sanmay Das, Professor, Computer Science, is conducting an exploratory study in the use of techniques from artificial intelligence (AI) to improve early screening and the delivery of targeted assistance to households that are at risk of future homelessness and child maltreatment. Das and the other members of the research team seek to develop novel methods for allocation of scarce housing support to at-risk households, taking into account considerations of both overall efficiency and fairness. This work will necessitate novel problem formulation and algorithm development in AI as well as creating new ethical methods for deciding on how to effectively deliver social services while considering the vast complexity of human behavior. Das is collaborating with Patrick J. Fowler, Associate Professor at Washington University in St. Louis, on this project. The researchers will explore the feasibility of using novel algorithmic techniques to inform societal decision-making on the allocation of scarce resources, with the specific goal of improving service system outcomes for both homelessness and child welfare.
10 Best + Free Python Bootcamp 2021-Take This Course
With the help of this list, all those learners who wish to learn all about Python Bootcamp can enroll in any of the suitable courses and start learning from it from the comfort of their homes, and that too for free. Below are the names and short descriptions of the 10 best and free Python Bootcamp courses for 2021. A Free Python Bootcamp Course course that will make you learn Python like a professional in no time. The Free Python Bootcamp course starts with the basics and then go all the way to creating your own applications and games. Throughout the Free Python Bootcamp course, you will be learning a variety of topics that will make you a professional at developing different applications and games. The instructor has delivered all the learning content that will help you learn both Python 2 and Python 3. Starting the Free Python Bootcamp course, you will learn to create games with Python.
How AI is Transforming the Education Industry
There is a popular media narrative that AI will take over teachers. If anything, AI will be a new tool in teachers' toolkits. Teachers spend a good portion of their time reeling with administrative burdens. AI will not replace them but free up their time to focus on what they do best – helping students grow to comprehend the world. ARTiBA explores the impact of Artificial Intelligence in Education, its future, and the ongoing AI and ML innovations in the sector.
Causal Navigation by Continuous-time Neural Networks
Vorbach, Charles, Hasani, Ramin, Amini, Alexander, Lechner, Mathias, Rus, Daniela
Imitation learning enables high-fidelity, vision-based learning of policies within rich, photorealistic environments. However, such techniques often rely on traditional discrete-time neural models and face difficulties in generalizing to domain shifts by failing to account for the causal relationships between the agent and the environment. In this paper, we propose a theoretical and experimental framework for learning causal representations using continuous-time neural networks, specifically over their discrete-time counterparts. We evaluate our method in the context of visual-control learning of drones over a series of complex tasks, ranging from short- and long-term navigation, to chasing static and dynamic objects through photorealistic environments. Our results demonstrate that causal continuous-time deep models can perform robust navigation tasks, where advanced recurrent models fail. These models learn complex causal control representations directly from raw visual inputs and scale to solve a variety of tasks using imitation learning.
Fairness as Equality of Opportunity: Normative Guidance from Political Philosophy
Khan, Falaah Arif, Manis, Eleni, Stoyanovich, Julia
Recent interest in codifying fairness in Automated Decision Systems (ADS) has resulted in a wide range of formulations of what it means for an algorithmic system to be fair. Most of these propositions are inspired by, but inadequately grounded in, political philosophy scholarship. This paper aims to correct that deficit. We introduce a taxonomy of fairness ideals using doctrines of Equality of Opportunity (EOP) from political philosophy, clarifying their conceptions in philosophy and the proposed codification in fair machine learning. We arrange these fairness ideals onto an EOP spectrum, which serves as a useful frame to guide the design of a fair ADS in a given context. We use our fairness-as-EOP framework to re-interpret the impossibility results from a philosophical perspective, as the in-compatibility between different value systems, and demonstrate the utility of the framework with several real-world and hypothetical examples. Through our EOP-framework we hope to answer what it means for an ADS to be fair from a moral and political philosophy standpoint, and to pave the way for similar scholarship from ethics and legal experts.
Generating Contrastive Explanations for Inductive Logic Programming Based on a Near Miss Approach
Rabold, Johannes, Siebers, Michael, Schmid, Ute
In recent research, human-understandable explanations of machine learning models have received a lot of attention. Often explanations are given in form of model simplifications or visualizations. However, as shown in cognitive science as well as in early AI research, concept understanding can also be improved by the alignment of a given instance for a concept with a similar counterexample. Contrasting a given instance with a structurally similar example which does not belong to the concept highlights what characteristics are necessary for concept membership. Such near misses have been proposed by Winston (1970) as efficient guidance for learning in relational domains. We introduce an explanation generation algorithm for relational concepts learned with Inductive Logic Programming (\textsc{GeNME}). The algorithm identifies near miss examples from a given set of instances and ranks these examples by their degree of closeness to a specific positive instance. A modified rule which covers the near miss but not the original instance is given as an explanation. We illustrate \textsc{GeNME} with the well known family domain consisting of kinship relations, the visual relational Winston arches domain and a real-world domain dealing with file management. We also present a psychological experiment comparing human preferences of rule-based, example-based, and near miss explanations in the family and the arches domains.
GDI: Rethinking What Makes Reinforcement Learning Different From Supervised Learning
Fan, Jiajun, Xiao, Changnan, Huang, Yue
Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the training process. DQN found this property might cause instability for training, so it proposed effective methods to handle the downside of the property. Instead of focusing on the unfavourable aspects, we find it critical for RL to ease the gap between the estimated data distribution and the ground truth data distribution while supervised learning (SL) fails to do so. From this new perspective, we extend the basic paradigm of RL called the Generalized Policy Iteration (GPI) into a more generalized version, which is called the Generalized Data Distribution Iteration (GDI). We see massive RL algorithms and techniques can be unified into the GDI paradigm, which can be considered as one of the special cases of GDI. We provide theoretical proof of why GDI is better than GPI and how it works. Several practical algorithms based on GDI have been proposed to verify the effectiveness and extensiveness of it. Empirical experiments prove our state-of-the-art (SOTA) performance on Arcade Learning Environment (ALE), wherein our algorithm has achieved 9620.98% mean human normalized score (HNS), 1146.39% median HNS and 22 human world record breakthroughs (HWRB) using only 200 training frames. Our work aims to lead the RL research to step into the journey of conquering the human world records and seek real superhuman agents on both performance and efficiency.
Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nystr\"om Method, and Use of Kernels in Machine Learning: Tutorial and Survey
Ghojogh, Benyamin, Ghodsi, Ali, Karray, Fakhri, Crowley, Mark
This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing Kernel Hilbert Space (RKHS), Mercer's theorem and its proof, frequently used kernels, kernel construction from distance metric, important classes of kernels (including bounded, integrally positive definite, universal, stationary, and characteristic kernels), kernel centering and normalization, and eigenfunctions are explained in detail. Then, we introduce types of use of kernels in machine learning including kernel methods (such as kernel support vector machines), kernel learning by semi-definite programming, Hilbert-Schmidt independence criterion, maximum mean discrepancy, kernel mean embedding, and kernel dimensionality reduction. We also cover rank and factorization of kernel matrix as well as the approximation of eigenfunctions and kernels using the Nystr{\"o}m method. This paper can be useful for various fields of science including machine learning, dimensionality reduction, functional analysis in mathematics, and mathematical physics in quantum mechanics.
Online Learning with Uncertain Feedback Graphs
Online learning with expert advice is widely used in various machine learning tasks. It considers the problem where a learner chooses one from a set of experts to take advice and make a decision. In many learning problems, experts may be related, henceforth the learner can observe the losses associated with a subset of experts that are related to the chosen one. In this context, the relationship among experts can be captured by a feedback graph, which can be used to assist the learner's decision making. However, in practice, the nominal feedback graph often entails uncertainties, which renders it impossible to reveal the actual relationship among experts. To cope with this challenge, the present work studies various cases of potential uncertainties, and develops novel online learning algorithms to deal with uncertainties while making use of the uncertain feedback graph. The proposed algorithms are proved to enjoy sublinear regret under mild conditions. Experiments on real datasets are presented to demonstrate the effectiveness of the novel algorithms.
Canonical-Correlation-Based Fast Feature Selection
Zhang, Sikai, Wang, Tingna, Worden, Keith, Cross, Elizabeth J.
This paper proposes a canonical-correlation-based filter method for feature selection. The sum of squared canonical correlation coefficients is adopted as the feature ranking criterion. The proposed method boosts the computational speed of the ranking criterion in greedy search. The supporting theorems developed for the feature selection method are fundamental to the understanding of the canonical correlation analysis. In empirical studies, a synthetic dataset is used to demonstrate the speed advantage of the proposed method, and eight real datasets are applied to show the effectiveness of the proposed feature ranking criterion in both classification and regression. The results show that the proposed method is considerably faster than the definition-based method, and the proposed ranking criterion is competitive compared with the seven mutual-information-based criteria.