Goto

Collaborating Authors

 Education


Self-PU: Self Boosted and Calibrated Positive-Unlabeled Training

arXiv.org Machine Learning

Many real-world applications have to tackle the Positive-Unlabeled (PU) learning problem, i.e., learning binary classifiers from a large amount of unlabeled data and a few labeled positive examples. While current state-of-the-art methods employ importance reweighting to design various risk estimators, they ignored the learning capability of the model itself, which could have provided reliable supervision. This motivates us to propose a novel Self-PU learning framework, which seamlessly integrates PU learning and self-training. Self-PU highlights three "self"-oriented building blocks: a self-paced training algorithm that adaptively discovers and augments confident positive/negative examples as the training proceeds; a self-calibrated instance-aware loss; and a self-distillation scheme that introduces teacher-students learning as an effective regularization for PU learning. We demonstrate the state-of-the-art performance of Self-PU on common PU learning benchmarks (MNIST and CIFAR-10), which compare favorably against the latest competitors. Moreover, we study a real-world application of PU learning, i.e., classifying brain images of Alzheimer's Disease. Self-PU obtains significantly improved results on the renowned Alzheimer's Disease Neuroimaging Initiative (ADNI) database over existing methods. The code is publicly available at: https://github.com/TAMU-VITA/Self-PU.


Safe Reinforcement Learning via Curriculum Induction

arXiv.org Artificial Intelligence

In safety-critical applications, autonomous agents may need to learn in an environment where mistakes can be very costly. In such settings, the agent needs to behave safely not only after but also while learning. To achieve this, existing safe reinforcement learning methods make an agent rely on priors that let it avoid dangerous situations during exploration with high probability, but both the probabilistic guarantees and the smoothness assumptions inherent in the priors are not viable in many scenarios of interest such as autonomous driving. This paper presents an alternative approach inspired by human teaching, where an agent learns under the supervision of an automatic instructor that saves the agent from violating constraints during learning. In this model, we introduce the monitor that neither needs to know how to do well at the task the agent is learning nor needs to know how the environment works. Instead, it has a library of reset controllers that it activates when the agent starts behaving dangerously, preventing it from doing damage. Crucially, the choices of which reset controller to apply in which situation affect the speed of agent learning. Based on observing agents' progress, the teacher itself learns a policy for choosing the reset controllers, a curriculum, to optimize the agent's final policy reward. Our experiments use this framework in two environments to induce curricula for safe and efficient learning.


A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics, and Benchmark Datasets

arXiv.org Artificial Intelligence

Machine Reading Comprehension (MRC) is a challenging NLP research field with wide real world applications. The great progress of this field in recent years is mainly due to the emergence of large-scale datasets and deep learning. At present, a lot of MRC models have already surpassed the human performance on many datasets despite the obvious giant gap between existing MRC models and genuine human-level reading comprehension. This shows the need of improving existing datasets, evaluation metrics and models to move the MRC models toward 'real' understanding. To address this lack of comprehensive survey of existing MRC tasks, evaluation metrics and datasets, herein, (1) we analyzed 57 MRC tasks and datasets; proposed a more precise classification method of MRC tasks with 4 different attributes (2) we summarized 9 evaluation metrics of MRC tasks and (3) 7 attributes and 10 characteristics of MRC datasets; (4) We also discussed some open issues in MRC research and highlight some future research directions. In addition, to help the community, we have collected, organized, and published our data on a companion website(https://mrc-datasets.github.io/) where MRC researchers could directly access each MRC dataset, papers, baseline projects and browse the leaderboard.


5 Resources For Kids To Learn Coding

#artificialintelligence

GitHub recently announced its partnership with Hack Club to support students with coding. Committing to a $50K hardware fund, it announced working globally alongside Arduino and Adafruit on delivering the hardware tools directly to students' homes. Designed for teenagers aged 13-18, the program is free of cost wherein students will have access to hardware on a needs basis and will have guidance from the industry mentors. This clearly tells us about the importance that global companies are laying on students and kids for coding. In this article, we list 5 institutes and initiatives that are working on teaching kids coding.


Artificial Intelligence for Finance, Accounting & Auditing

#artificialintelligence

Udemy Coupon - Gain hands-on skills using 8 AI techniques (no coding!), and position yourself for this digital age (Level 1) Created by AI Ascent LLC. Course Instructor: Ivy Munoko, ACCA, CISA English [Auto-generated] Students also bought Artificial Intelligence A-Z: Learn How To Build An AI Deep Learning and Computer Vision A-Z: OpenCV, SSD & GANs Artificial Intelligence 2018: Build the Most Powerful AI Artificial Intelligence: Reinforcement Learning in Python Artificial Intelligence II - Neural Networks in Java Preview this Course GET COUPON CODE Description This course will provide students and professionals a 360 degree view of the current Artificial Intelligence techniques used in Business, Finance, Accounting and Auditing. Through a mix of lectures, hands-on exercises (code free!), case studies, reflection exercises and knowledge-check quizzes, this course will provide a quick and deep overview of Artificial Intelligence (AI) in business. In this digital age, all careers have a computing element as digitization and automation comes to the forefront of business processes. Those who complete this course will be able to reposition themselves to initiate and implement AI innovation within their teams, and confidently walk into this AI age.


r/artificial - How can I begin learning about programming AI/ML?

#artificialintelligence

I am a recent college graduate with a degree in Software Engineering. Being honest with myself, I would say my programming skills are intermediate, but not expert level in any way (I have about a year of professional experience). I am comfortable with Java and know a bit about JS, HTML/CSS, and Python. Something I've recently come to be very interested in is the field of artificial intelligence. I think I have a basic understanding of what it is, but no clue how it works.


Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferences

arXiv.org Artificial Intelligence

We consider an inverse reinforcement learning problem involving us versus an enemy radar equipped with a Bayesian tracker. By observing the emissions of the enemy radar,how can we identify if the radar is cognitive (constrained utility maximizer)? Given the observed sequence of actions taken by the enemy's radar, we consider three problems: (i) Are the enemy radar's actions (waveform choice, beam scheduling) consistent with constrained utility maximization? If so how can we estimate the cognitive radar's utility function that is consistent with its actions. We formulate and solve the problem in terms of the spectra (eigenvalues) of the state and observation noise covariance matrices, and the algebraic Riccati equation. (ii) How to construct a statistical test for detecting a cognitive radar (constrained utility maximization) when we observe the radar's actions in noise or the radar observes our probe signal in noise? We propose a statistical detector with a tight Type-II error bound. (iii) How can we optimally probe (interrogate) the enemy's radar by choosing our state to minimize the Type-II error of detecting if the radar is deploying an economic rational strategy, subject to a constraint on the Type-I detection error? We present a stochastic optimization algorithm to optimize our probe signal. The main analysis framework used in this paper is that of revealed preferences from microeconomics.


Deep Polynomial Neural Networks

arXiv.org Machine Learning

Deep Convolutional Neural Networks (DCNNs) are currently the method of choice both for generative, as well as for discriminative learning in computer vision and machine learning. The success of DCNNs can be attributed to the careful selection of their building blocks (e.g., residual blocks, rectifiers, sophisticated normalization schemes, to mention but a few). In this paper, we propose $\Pi$-Nets, a new class of DCNNs. $\Pi$-Nets are polynomial neural networks, i.e., the output is a high-order polynomial of the input. The unknown parameters, which are naturally represented by high-order tensors, are estimated through a collective tensor factorization with factors sharing. We introduce three tensor decompositions that significantly reduce the number of parameters and show how they can be efficiently implemented by hierarchical neural networks. We empirically demonstrate that $\Pi$-Nets are very expressive and they even produce good results without the use of non-linear activation functions in a large battery of tasks and signals, i.e., images, graphs, and audio. When used in conjunction with activation functions, $\Pi$-Nets produce state-of-the-art results in three challenging tasks, i.e. image generation, face verification and 3D mesh representation learning.


The Data Science Life Cycle

Communications of the ACM

Victoria Stodden (vcs@stodden.net) is a statistician and associate professor at the University of Illinois at Urbana-Champaign, IL, USA. This material is based upon work supported by National Science Foundation Award #1941443.


Data Science Training Course: Data Scientist Bootcamp

#artificialintelligence

Data scientist is one of the best suited professions to thrive this century. It is digital, programming-oriented, and analytical. Therefore, it comes as no surprise that the demand for data scientists has been surging in the job marketplace. However, supply has been very limited. It is difficult to acquire the skills necessary to be hired as a data scientist.