Education
Improving Welfare in One-sided Matching using Simple Threshold Queries
Ma, Thomas, Menon, Vijay, Larson, Kate
We study one-sided matching problems where $n$ agents have preferences over $m$ objects and each of them need to be assigned to at most one object. Most work on such problems assume that the agents only have ordinal preferences and usually the goal in them is to compute a matching that satisfies some notion of economic efficiency. However, in reality, agents may have some preference intensities or cardinal utilities that, e.g., indicate that they like an an object much more than another object, and not taking these into account can result in a loss in welfare. While one way to potentially account for these is to directly ask the agents for this information, such an elicitation process is cognitively demanding. Therefore, we focus on learning more about their cardinal preferences using simple threshold queries which ask an agent if they value an object greater than a certain value, and use this in turn to come up with algorithms that produce a matching that, for a particular economic notion $X$, satisfies $X$ and also achieves a good approximation to the optimal welfare among all matchings that satisfy $X$. We focus on several notions of economic efficiency, and look at both adaptive and non-adaptive algorithms. Overall, our results show how one can improve welfare by even non-adaptively asking the agents for just one bit of extra information per object.
An open-ended learning architecture to face the REAL 2020 simulated robot competition
Cartoni, Emilio, Montella, Davide, Triesch, Jochen, Baldassarre, Gianluca
Open-ended learning is a core research field of machine learning and robotics aiming to build learning machines and robots able to autonomously acquire knowledge and skills and to reuse them to solve novel tasks. The multiple challenges posed by open-ended learning have been operationalized in the robotic competition REAL 2020. This requires a simulated camera-arm-gripper robot to (a) autonomously learn to interact with objects during an intrinsic phase where it can learn how to move objects and then (b) during an extrinsic phase, to re-use the acquired knowledge to accomplish externally given goals requiring the robot to move objects to specific locations unknown during the intrinsic phase. Here we present a 'baseline architecture' for solving the challenge, provided as baseline model for REAL 2020. Few models have all the functionalities needed to solve the REAL 2020 benchmark and none has been tested with it yet. The architecture we propose is formed by three components: (1) Abstractor: abstracting sensory input to learn relevant control variables from images; (2) Explorer: generating experience to learn goals and actions; (3) Planner: formulating and executing action plans to accomplish the externally provided goals. The architecture represents the first model to solve the simpler REAL 2020 'Round 1' allowing the use of a simple parameterised push action. On Round 2, the architecture was used with a more general action (sequence of joints positions) achieving again higher than chance level performance. The baseline software is well documented and available for download and use at https://github.com/AIcrowd/REAL2020_starter_kit.
A Temporal Neural Network Architecture for Online Learning
A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are SNNs that communicate and process information encoded as relative spike times (in contrast to spike rates). A TNN architecture is proposed, and, as a proof-of-concept, TNN operation is demonstrated within the larger context of online supervised classification. First, through unsupervised learning, a TNN partitions input patterns into clusters based on similarity. The TNN then passes a cluster identifier to a simple online supervised decoder which finishes the classification task. The TNN learning process adjusts synaptic weights by using only signals local to each synapse, and clustering behavior emerges globally. The system architecture is described at an abstraction level analogous to the gate and register transfer levels in conventional digital design. Besides features of the overall architecture, several TNN components are new to this work. Although not addressed directly, the overall research objective is a direct hardware implementation of TNNs. Consequently, all the architecture elements are simple, and processing is done at very low precision. Importantly, low precision leads to very fast learning times. Simulation results using the time-honored MNIST dataset demonstrate learning times at least an order of magnitude faster than other online approaches while providing similar error rates.
Rethinking Generalization in American Sign Language Prediction for Edge Devices with Extremely Low Memory Footprint
Paul, Aditya Jyoti, Mohan, Puranjay, Sehgal, Stuti
Due to the boom in technical compute in the last few years, the world has seen massive advances in artificially intelligent systems solving diverse real-world problems. But a major roadblock in the ubiquitous acceptance of these models is their enormous computational complexity and memory footprint. Hence efficient architectures and training techniques are required for deployment on extremely low resource inference endpoints. This paper proposes an architecture for detection of alphabets in American Sign Language on an ARM Cortex-M7 microcontroller having just 496 KB of framebuffer RAM. Leveraging parameter quantization is a common technique that might cause varying drops in test accuracy. This paper proposes using interpolation as augmentation amongst other techniques as an efficient method of reducing this drop, which also helps the model generalize well to previously unseen noisy data. The proposed model is about 185 KB post-quantization and inference speed is 20 frames per second.
Skill Transfer via Partially Amortized Hierarchical Planning
Xie, Kevin, Bharadhwaj, Homanga, Hafner, Danijar, Garg, Animesh, Shkurti, Florian
To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture general behaviors that can apply to new tasks. In this paper, we investigate how these two approaches can be integrated into a single reinforcement learning agent. Specifically, we leverage the idea of partial amortization for fast adaptation at test time. For this, actions are produced by a policy that is learned over time while the skills it conditions on are chosen using online planning. We demonstrate the benefits of our design decisions across a suite of challenging locomotion tasks and demonstrate improved sample efficiency in single tasks as well as in transfer from one task to another, as compared to competitive baselines. Videos are available at: https://sites.google.com/view/partial-amortization-hierarchy/home
Welcome to the Ethics of AI webinar on 27 November
In this event, you will learn about real-life challenges and solutions regarding the use of artificial intelligence. You will also get acquainted with the newly published open online course Ethics of AI, where you can enhance your own skills in addressing these issues. You will also hear more about the challenges and possibilities of using artificial intelligence in public services in the cities of Helsinki, London and Amsterdam and the Ministry of Finance of Finland. Our keynotes are Jan Vapaavuori, Mayor of Helsinki and Pekka Ala-Pietilรค, chair of the EU commission High-Level Expert Group on Artificial Intelligence. The host of the event is Santeri Rรคisรคnen.
Deep Learning Prerequisites: Logistic Regression in Python
Online Courses Udemy - Data science techniques for professionals and students - learn the theory behind logistic regression and code in Python BESTSELLER Created by Lazy Programmer Inc English [Auto-generated], Portuguese [Auto-generated], 1 more Students also bought Data Science: Deep Learning in Python Natural Language Processing with Deep Learning in Python Advanced AI: Deep Reinforcement Learning in Python Deep Learning: Advanced NLP and RNNs Deep Learning A-Z: Hands-On Artificial Neural Networks Preview this course GET COUPON CODE Description This course is a lead-in to deep learning and neural networks - it covers a popular and fundamental technique used in machine learning, data science and statistics: logistic regression. We cover the theory from the ground up: derivation of the solution, and applications to real-world problems. We show you how one might code their own logistic regression module in Python. This course does not require any external materials. Everything needed (Python, and some Python libraries) can be obtained for free.
Dive into Python and AI with this online training bundle
If you're an aspiring or even established developer, choosing which programming language to learn next can be a daunting task. There are so many programming languages to choose from, and each one tends to be suited for a specific subspecialty of tech. But if you haven't already learned Python, you can call off the search. This incredibly powerful and popular programming language is used to build everything from apps to the latest artificial intelligence (AI) software and technologies. The Ultimate Python & Artificial Intelligence Certification Bundle will teach you everything you need to know for just $39.99--over 95% off its usual price for a limited time.
The new world of L&D needs Hybrid Training Strategy
The new world of L&D is all about making people adapt to the demand in Cross-Skilling & Up-Skilling their resources. Organization are struggling to keep pace with the unprecedented demands in bringing together the skill requirement to meet the business outcome. Moving away from Ad-hoc & calendar programs to Strategy Solutions do post as a challenge. As a result, it's mission-critical that workforce transformation has a significant role to play in the future, keeping up with the pace of business demand. What is Workforce Transformation Model?