Goto

Collaborating Authors

 Education


Adaptive Policy Transfer in Reinforcement Learning

arXiv.org Artificial Intelligence

Efficient and robust policy transfer remains a key challenge for reinforcement learning to become viable for real-wold robotics. Policy transfer through warm initialization, imitation, or interacting over a large set of agents with randomized instances, have been commonly applied to solve a variety of Reinforcement Learning tasks. However, this seems far from how skill transfer happens in the biological world: Humans and animals are able to quickly adapt the learned behaviors between similar tasks and learn new skills when presented with new situations. Here we seek to answer the question: Will learning to combine adaptation and exploration lead to a more efficient transfer of policies between domains? We introduce a principled mechanism that can "Adapt-to-Learn", that is adapt the source policy to learn to solve a target task with significant transition differences and uncertainties. We show that the presented method learns to seamlessly combine learning from adaptation and exploration and leads to a robust policy transfer algorithm with significantly reduced sample complexity in transferring skills between related tasks.


Parameter-free Gradient Temporal Difference Learning

arXiv.org Artificial Intelligence

Reinforcement learning lies at the intersection of several challenges. Many applications of interest involve extremely large state spaces, requiring function approximation to enable tractable computation. In addition, the learner has only a single stream of experience with which to evaluate a large number of possible courses of action, necessitating algorithms which can learn off-policy. However, the combination of off-policy learning with function approximation leads to divergence of temporal difference methods. Recent work into gradient-based temporal difference methods has promised a path to stability, but at the cost of expensive hyperparameter tuning. In parallel, progress in online learning has provided parameter-free methods that achieve minimax optimal guarantees up to logarithmic terms, but their application in reinforcement learning has yet to be explored. In this work, we combine these two lines of attack, deriving parameter-free, gradient-based temporal difference algorithms. Our algorithms run in linear time and achieve high-probability convergence guarantees matching those of GTD2 up to $\log$ factors. Our experiments demonstrate that our methods maintain high prediction performance relative to fully-tuned baselines, with no tuning whatsoever.


ExpMRC: Explainability Evaluation for Machine Reading Comprehension

arXiv.org Artificial Intelligence

Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, it is necessary to provide both answer prediction and its explanation to further improve the MRC system's reliability, especially for real-life applications. In this paper, we propose a new benchmark called ExpMRC for evaluating the explainability of the MRC systems. ExpMRC contains four subsets, including SQuAD, CMRC 2018, RACE$^+$, and C$^3$ with additional annotations of the answer's evidence. The MRC systems are required to give not only the correct answer but also its explanation. We use state-of-the-art pre-trained language models to build baseline systems and adopt various unsupervised approaches to extract evidence without a human-annotated training set. The experimental results show that these models are still far from human performance, suggesting that the ExpMRC is challenging. Resources will be available through https://github.com/ymcui/expmrc


Non-asymptotic model selection in block-diagonal mixture of polynomial experts models

arXiv.org Artificial Intelligence

Model selection, via penalized likelihood type criteria, is a standard task in many statistical inference and machine learning problems. Progress has led to deriving criteria with asymptotic consistency results and an increasing emphasis on introducing non-asymptotic criteria. We focus on the problem of modeling non-linear relationships in regression data with potential hidden graph-structured interactions between the high-dimensional predictors, within the mixture of experts modeling framework. In order to deal with such a complex situation, we investigate a block-diagonal localized mixture of polynomial experts (BLoMPE) regression model, which is constructed upon an inverse regression and block-diagonal structures of the Gaussian expert covariance matrices. We introduce a penalized maximum likelihood selection criterion to estimate the unknown conditional density of the regression model. This model selection criterion allows us to handle the challenging problem of inferring the number of mixture components, the degree of polynomial mean functions, and the hidden block-diagonal structures of the covariance matrices, which reduces the number of parameters to be estimated and leads to a trade-off between complexity and sparsity in the model. In particular, we provide a strong theoretical guarantee: a finite-sample oracle inequality satisfied by the penalized maximum likelihood estimator with a Jensen-Kullback-Leibler type loss, to support the introduced non-asymptotic model selection criterion. The penalty shape of this criterion depends on the complexity of the considered random subcollection of BLoMPE models, including the relevant graph structures, the degree of polynomial mean functions, and the number of mixture components.


The 13 Best Machine Learning Certifications Online for 2021

#artificialintelligence

The editors at Solutions Review have compiled this list of the best machine learning certifications online to consider acquiring. Machine learning involves studying computer algorithms that improve automatically through experience. It is a sub-field of artificial intelligence where machine learning algorithms build models based on sample (or training) data. Once a predictive model is constructed it can be used to make predictions or decisions without being specifically commanded to do so. Machine learning is now a mainstream technology with a wide variety of uses and applications.


Deep Learning for Beginners in Python: Work On 12+ Projects

#artificialintelligence

The Artificial Intelligence and Deep Learning are growing exponentially in today's world. There are multiple application of AI and Deep Learning like Self Driving Cars, Chat-bots, Image Recognition, Virtual Assistance, ALEXA, so on... With this course you will understand the complexities of Deep Learning in easy way, as well as you will have A Complete Understanding of Googles TensorFlow 2.0 Framework TensorFlow 2.0 Framework has amazing features that simplify the Model Development, Maintenance, Processes and Performance In TensorFlow 2.0 you can start the coding with Zero Installation, whether you're an expert or a beginner, in this course you will learn an end-to-end implementation of Deep Learning Algorithms So what are you waiting for, Enroll Now and understand Deep Learning to advance your career and increase your knowledge!


Harnessing the power of machine learning with MLOps

#artificialintelligence

MLOps, a compound of "machine learning" and "information technology operations," is a newer discipline involving collaboration between data scientists and IT professionals with the aim of productizing machine learning algorithms. The market for such solutions could grow from a nascent $350 million to $4 billion by 2025, according to Cognilytica. But certain nuances can make implementing MLOps a challenge. A survey by NewVantage Partners found that only 15% of leading enterprises have deployed AI capabilities into production at any scale. Still, the business value of MLOps can't be ignored.


Directional Convergence Analysis under Spherically Symmetric Distribution

arXiv.org Machine Learning

We consider the fundamental problem of learning linear predictors (i.e., separable datasets with zero margin) using neural networks with gradient flow or gradient descent. Under the assumption of spherically symmetric data distribution, we show directional convergence guarantees with exact convergence rate for two-layer non-linear networks with only two hidden nodes, and (deep) linear networks. Moreover, our discovery is built on dynamic from the initialization without both initial loss and perfect classification constraint in contrast to previous works. We also point out and study the challenges in further strengthening and generalizing our results.


Why are neural networks so powerful?

#artificialintelligence

It is common knowledge that neural networks are very powerful and they can be used for almost any statistical learning problem with great results. But have you thought about why is this the case? Why is this method more powerful in most scenarios than many other algorithms? As always with machine learning, there is a precise mathematical reason for this. Simply saying, the set of functions described by a neural network model is very large.


Co-Op/Intern Machine Learning Developer, Machine Learning Solutions

#artificialintelligence

At Kinaxis, who we are is grounded in our common belief that people matter. Each one of us plays an important part in accomplishing our work, building our culture and making a global impact. Every day, we're empowered to work together to help our customers make fast, confident planning decisions. This is how we create a better planet โ€“ for each other, for our customers and for generations to come. Our cloud-based platform RapidResponse ensures that the products we need โ€“ everything from medicine and cars, to day-to-day items like toothpaste โ€“ make it to market and into our hands when we need them with minimal ecological footprint.