Goto

Collaborating Authors

 Education


An Extensible Interactive Interface for Agent Design

arXiv.org Machine Learning

In artificial intelligence, we often specify tasks through a reward function. While this works well in some settings, many tasks are hard to specify this way. In deep reinforcement learning, for example, directly specifying a reward as a function of a high-dimensional observation is challenging. Instead, we present an interface for specifying tasks interactively using demonstrations. Our approach defines a set of increasingly complex policies. The interface allows the user to switch between these policies at fixed intervals to generate demonstrations of novel, more complex, tasks. We train new policies based on these demonstrations and repeat the process. We present a case study of our approach in the Lunar Lander domain, and show that this simple approach can quickly learn a successful landing policy and outperforms an existing comparison-based deep RL method.


Assessing the Robustness of Bayesian Dark Knowledge to Posterior Uncertainty

arXiv.org Machine Learning

Further, the authors show that this approach is into a single network representing the posterior successful in the classification setting using a student network predictive distribution. Further, the authors whose architecture matches that of a single network show that this approach is successful in the classification in the teacher ensemble. The Bayesian Dark Knowledge setting using a student network whose architecture method also uses online learning of the student model based matches that of a single network in the on single samples from the parameter posterior, resulting in teacher ensemble. In this work, we examine the a training algorithm that requires only twice as much space robustness of Bayesian Dark Knowledge to higher as a standard point estimate-based learning procedure.


Autonomous Goal Exploration using Learned Goal Spaces for Visuomotor Skill Acquisition in Robots

arXiv.org Artificial Intelligence

The automatic and efficient discovery of skills, without supervision, for long-living autonomous agents, remains a challenge of Artificial Intelligence. Intrinsically Motivated Goal Exploration Processes give learning agents a human-inspired mechanism to sequentially select goals to achieve. This approach gives a new perspective on the lifelong learning problem, with promising results on both simulated and real-world experiments. Until recently, those algorithms were restricted to domains with experimenter-knowledge, since the Goal Space used by the agents was built on engineered feature extractors. The recent advances of deep representation learning, enables new ways of designing those feature extractors, using directly the agent experience. Recent work has shown the potential of those methods on simple yet challenging simulated domains. In this paper, we present recent results showing the applicability of those principles on a real-world robotic setup, where a 6-joint robotic arm learns to manipulate a ball inside an arena, by choosing goals in a space learned from its past experience.


The Best Machine Learning Course to Learn 2019

#artificialintelligence

The Best Machine Learning Course to Learn 2019(view) โ€“ This online course explains a detailed introduction to Machine Learning, data mining, and statistical pattern recognition. The course will also cover several case studies and applications which are very helpful, so that students also get to know how to apply learning algorithms to creating smart robots (perception, control), text understanding (web search, anti-spam), computer vision, medical informatics, audio, database mining, and other areas. I would like to recommend this course to any students who is interested in learning machine learning as it is amazing and has been great help to students. It has Flexible schedule and deadlines. The best way to complete it in 7 hours per week.


Trend Brief: Gender Bias in AI - Catalyst

#artificialintelligence

The field of artificial intelligence (AI) is growing at a rapid pace, developing algorithms and automated machines that show promise in making the workplace more efficient and less biased. Many of us already interact with artificial intelligence in our daily lives, often without even realizing it--it's responsible for everything from credit score calculators to search engine results to what we see on social media.1 Likewise, organizations have introduced AI into many work processes, especially recruiting and talent-management functions. In many cases, algorithms sort through numerous factors to profile people and make predictions about them. AI hiring and talent-management systems have the potential to move the needle on gender equality in workplaces by using more objective criteria in recruiting and promoting talent.2 But what happens if the algorithm is actually relying on biased input to make predictions?


For the Successful Future of AI, Women Have to Take the Lead

#artificialintelligence

"The most exciting breakthroughs of the twenty-first century will not occur because of technology, but because of an expanding concept of what it means to be human" Before we dive into why more women should lead AI teams, I want to share a fascinating story I heard from Tania Biland, a 3rd-year student of Lucerne University of Applied Sciences and Arts. After 4 weeks of work, each team had to present their work. Group 1, composed of only women, developed a safety solution for women in the dark. As the jury was only male we decided to tell a story using a persona, music, and videos in order to make them feel what women are experiencing on a daily basis. We also put emphasis on the fact that everyone has a mother, sister or wife in their life and that they probably don't want her/them to suffer.


Open-source bionic leg aims to rapidly advance prosthetics

#artificialintelligence

A new open-source, artificially intelligent prosthetic leg designed by University of Michigan and Shirley Ryan AbilityLab researchers is now available to the scientific community. Opensourceleg.com has been created to offer a united platform to combine and accelerate research efforts across the bionics field. The University of Michigan College of Engineering is one of the world's top engineering schools. Michigan Engineering is home to 12 highly-ranked departments, and its research budget is among the largest of any public university. Instead of starting from scratch, these researchers can take this common platform and, after some assembly, begin working on better solutions to help people with mobility impairments.


Louisville partners with Microsoft to become artificial intelligence hub

#artificialintelligence

Dave Christopher with AMPED (Academy of Music Education, Production and Development) started his organization to advance kids in low-income areas, teaching them vital skills in music and tech. As a child of poverty whose parents couldn't afford college, Christopher said he taught himself IT. Now with almost 30 years in the technology field under his belt, he's still only worked with less than 30 African-Americans.


Dynamic Network Embedding via Incremental Skip-gram with Negative Sampling

arXiv.org Machine Learning

Network representation learning, as an approach to learn low dimensional representations of vertices, has attracted considerable research attention recently. It has been proven extremely useful in many machine learning tasks over large graph. Most existing methods focus on learning the structural representations of vertices in a static network, but cannot guarantee an accurate and efficient embedding in a dynamic network scenario. To address this issue, we present an efficient incremental skip-gram algorithm with negative sampling for dynamic network embedding, and provide a set of theoretical analyses to characterize the performance guarantee. Specifically, we first partition a dynamic network into the updated, including addition/deletion of links and vertices, and the retained networks over time. Then we factorize the objective function of network embedding into the added, vanished and retained parts of the network. Next we provide a new stochastic gradient-based method, guided by the partitions of the network, to update the nodes and the parameter vectors. The proposed algorithm is proven to yield an objective function value with a bounded difference to that of the original objective function. Experimental results show that our proposal can significantly reduce the training time while preserving the comparable performance. We also demonstrate the correctness of the theoretical analysis and the practical usefulness of the dynamic network embedding. We perform extensive experiments on multiple real-world large network datasets over multi-label classification and link prediction tasks to evaluate the effectiveness and efficiency of the proposed framework, and up to 22 times speedup has been achieved.


Factorization Bandits for Online Influence Maximization

arXiv.org Machine Learning

We study the problem of online influence maximization in social networks. In this problem, a learner aims to identify the set of "best influencers" in a network by interacting with it, i.e., repeatedly selecting seed nodes and observing activation feedback in the network. We capitalize on an important property of the influence maximization problem named network assortativity, which is ignored by most existing works in online influence maximization. To realize network assortativity, we factorize the activation probability on the edges into latent factors on the corresponding nodes, including influence factor on the giving nodes and susceptibility factor on the receiving nodes. We propose an upper confidence bound based online learning solution to estimate the latent factors, and therefore the activation probabilities. Considerable regret reduction is achieved by our factorization based online influence maximization algorithm. And extensive empirical evaluations on two real-world networks showed the effectiveness of our proposed solution.