Goto

Collaborating Authors

 Education


Decomposed Inductive Procedure Learning

arXiv.org Artificial Intelligence

Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capabilities often necessitates millions of annotated examples -- far more than humans typically need in order to achieve a passing level of mastery on similar tasks. Thus, while contemporary methods in machine learning can produce agents that exhibit super-human performance, their rate of learning per opportunity in many domains is decidedly lower than human-learning. In this work we formalize a theory of Decomposed Inductive Procedure Learning (DIPL) that outlines how different forms of inductive symbolic learning can be used in combination to build agents that learn educationally relevant tasks such as mathematical, and scientific procedures, at a rate similar to human learners. We motivate the construction of this theory along Marr's concepts of the computational, algorithmic, and implementation levels of cognitive modeling, and outline at the computational-level six learning capacities that must be achieved to accurately model human learning. We demonstrate that agents built along the DIPL theory are amenable to satisfying these capacities, and demonstrate, both empirically and theoretically, that DIPL enables the creation of agents that exhibit human-like learning performance.


IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning

arXiv.org Artificial Intelligence

Current visual question answering (VQA) tasks mainly consider answering human-annotated questions for natural images. However, aside from natural images, abstract diagrams with semantic richness are still understudied in visual understanding and reasoning research. In this work, we introduce a new challenge of Icon Question Answering (IconQA) with the goal of answering a question in an icon image context. We release IconQA, a large-scale dataset that consists of 107,439 questions and three sub-tasks: multi-image-choice, multi-text-choice, and filling-in-the-blank. The IconQA dataset is inspired by real-world diagram word problems that highlight the importance of abstract diagram understanding and comprehensive cognitive reasoning. Thus, IconQA requires not only perception skills like object recognition and text understanding, but also diverse cognitive reasoning skills, such as geometric reasoning, commonsense reasoning, and arithmetic reasoning. To facilitate potential IconQA models to learn semantic representations for icon images, we further release an icon dataset Icon645 which contains 645,687 colored icons on 377 classes. We conduct extensive user studies and blind experiments and reproduce a wide range of advanced VQA methods to benchmark the IconQA task. Also, we develop a strong IconQA baseline Patch-TRM that applies a pyramid cross-modal Transformer with input diagram embeddings pre-trained on the icon dataset. IconQA and Icon645 are available at https://iconqa.github.io.


Can Q-Learning be Improved with Advice?

arXiv.org Machine Learning

Despite rapid progress in theoretical reinforcement learning (RL) over the last few years, most of the known guarantees are worst-case in nature, failing to take advantage of structure that may be known a priori about a given RL problem at hand. In this paper we address the question of whether worst-case lower bounds for regret in online learning of Markov decision processes (MDPs) can be circumvented when information about the MDP, in the form of predictions about its optimal $Q$-value function, is given to the algorithm. We show that when the predictions about the optimal $Q$-value function satisfy a reasonably weak condition we call distillation, then we can improve regret bounds by replacing the set of state-action pairs with the set of state-action pairs on which the predictions are grossly inaccurate. This improvement holds for both uniform regret bounds and gap-based ones. Further, we are able to achieve this property with an algorithm that achieves sublinear regret when given arbitrary predictions (i.e., even those which are not a distillation). Our work extends a recent line of work on algorithms with predictions, which has typically focused on simple online problems such as caching and scheduling, to the more complex and general problem of reinforcement learning.


Mixture-of-Variational-Experts for Continual Learning

arXiv.org Machine Learning

One significant shortcoming of machine learning is the poor ability of models to solve new problems quicker and without forgetting acquired knowledge. To better understand this issue, continual learning has emerged to systematically investigate learning protocols where the model sequentially observes samples generated by a series of tasks. First, we propose an optimality principle that facilitates a trade-off between learning and forgetting. We derive this principle from an information-theoretic formulation of bounded rationality and show its connections to other continual learning methods. Second, based on this principle, we propose a neural network layer for continual learning, called Mixture-of-Variational-Experts (MoVE), that alleviates forgetting while enabling the beneficial transfer of knowledge to new tasks. Our experiments on variants of the MNIST and CIFAR10 datasets demonstrate the competitive performance of MoVE layers when compared to state-of-the-art approaches.


5 Concrete Benefits of Bayesian Statistics

#artificialintelligence

Many of us (myself included) have felt discouraged from using Bayesian statistics for analysis. Supposedly, Bayesian statistics has a bad reputation: it is difficult and heavily dependent on math. Also, because of its relevance to many fields, Data Science included, writers and professionals, want to get a head start by publishing articles on how the formula works. I believe data professionals, academics, existing books, and online courses are responsible for creating the negative stereotype of Bayes' hard work. We can all agree that not everyone is attracted to mathematical formulas.


Top 10 Boot Camps to Learn Machine Learning in 2021

#artificialintelligence

Machine learning technology can autonomously identify malignant tumors, pilot Teslas, and subtitle videos in real-time. The term "autonomous" is tricky here because machine learning still requires a lot of human ingenuity to get these jobs done. It works like this: An algorithm scans a massive dataset. Engineers don't tell it exactly what to look for in this initial dataset, which could consist of images, audio clips, emails, and more. Instead, the algorithm conducts a freeform analysis.


[Udemy Coupon] The Complete Intro to Machine Learning with Python

#artificialintelligence

Udemy Coupon Code For The Complete Intro to Machine Learning with Python, Find Out Other Highest rated and Bestselling Python Courses with Discount Coupon Codes.


Data Science Learning Roadmap 2021

#artificialintelligence

Although nothing changes except for the date, a new year fills everyone with the hope of starting things afresh. Adding a bit of planning, well-envisioned goals and a learning roadmap makes for a great recipe for a year full of growth. This post intends to strengthen your plan by providing you with a learning framework, resources, and project ideas to build a solid portfolio of work showcasing expertise in data science. This is a tough question. Where do you start when you want to break into data science?


Why Python developers are paid so much ? - Salesforcecertificationaidpractisexams

#artificialintelligence

Python to be the multiprogramming language since it has all features of conventional Latest programing language. It continuously serves as a best language for developing applications efficiently. Python is the fastest-growing language without any threats. Machine Learning and artificial intelligence (AI)is everywhere; if you want to know how companies like Google, Amazon, and even Udemy extract meaning and insightsfrom massive data sets, this data science course will give you the fundamentals you need. Data Scientists enjoy one of the top-paying jobs,with an average salary of $120,000 according to Glassdoor and Indeed. The lowest salary of Python Developers you can see in Nebraska (NE) $85,000 and Indiana (IN) $87,750.Learn Python now for 12.99$