Goto

Collaborating Authors

 Education


[Another] Deep Learning Hardware Guide

#artificialintelligence

So, you've decided you want to purchase a machine dedicated to training machine learning models. Or, rather, you work in an organization where the buzzwords of this guide are constantly thrown around and you simply want to know a bit more about what they mean. This isn't a terribly simple topic, so I've decided to write this guide. You can discuss those terms from various angles, and this guide will tackle one of them. I'm Nir Ben-Zvi, a Deep Learning researcher and a hardware enthusiast from early middle school days, where I would tear computers apart while friends were playing basketball (tried that too, went back to hardware pretty fast). In the past few years I got to consult some friends on building deep learning machines for companies of various sizes, and ultimately decided to put that knowledge into this guide. Today I work for trigo, doing some Deep Learning and Data. A lot of the knowledge for this guide came from the decisions made towards building our first deep learning machines. Some parts of this guide are kept despite being way out of date.


Artificial Intelligence and the Future of Work (2021)

#artificialintelligence

Artificial Intelligence and the Future of Work (2021) - Welcome to the new Artificial Intelligence (AI) Technology Revolution in 2021 impacting workplaces worldwide. Created by Srinidhi Ranganathan Students also bought Artificial Intelligence A-Z: Learn How To Build An AI Deep Learning and Computer Vision A-Z: OpenCV, SSD & GANs Artificial Intelligence: Reinforcement Learning in Python The Beginner's Guide to Artificial Intelligence in Unity.Preview this course Udemy GET COUPON CODE A great technological shift is on the verge of occurring very soon. Disruptive Artificial Intelligence technologies are going to change the world and human labor will be replaced by robot workers and the shift has in-fact started. This mind-blowing course introduces you to the concept of Artificial Intelligence usage in the workplace along with providing you practical examples of the different platforms that deploy the same for automation. You will learn about the numerous Human Resources tools and usage of these in Artificial Intelligence, along with sales-based AI tools that can help you close the deal.


Data Science with Python Course : Hands-on Data Science 2020

#artificialintelligence

And Many Machine learning algorithm yet to come. Data Science Prerequisite: Basics of Probability and statistics Setup Data Science and Machine learning lab in Microsoft Azure Cloud This course is for beginner and some experienced programmer who want to make career in Data Science and Machine learning, AI. basic knowledge in python programming (will be covered in python) High School mathematics Enroll in this course, take look at brief curriculum of this course and take first step in wonderful world of Data. Who this course is for: Anyone who is interested in DataScience Anyone who wants to learn - How to analyze data Those who want to make career in Data analytics, Machine learning, DataScience 100% Off Udemy Coupon .


NLPGym -- A toolkit for evaluating RL agents on Natural Language Processing Tasks

arXiv.org Artificial Intelligence

Reinforcement learning (RL) has recently shown impressive performance in complex game AI and robotics tasks. To a large extent, this is thanks to the availability of simulated environments such as OpenAI Gym, Atari Learning Environment, or Malmo which allow agents to learn complex tasks through interaction with virtual environments. While RL is also increasingly applied to natural language processing (NLP), there are no simulated textual environments available for researchers to apply and consistently benchmark RL on NLP tasks. With the work reported here, we therefore release NLPGym, an open-source Python toolkit that provides interactive textual environments for standard NLP tasks such as sequence tagging, multi-label classification, and question answering. We also present experimental results for 6 tasks using different RL algorithms which serve as baselines for further research. The toolkit is published at https://github.com/rajcscw/nlp-gym


Generative Data Augmentation for Commonsense Reasoning

arXiv.org Artificial Intelligence

Recent advances in commonsense reasoning depend on large-scale human-annotated training data to achieve peak performance. However, manual curation of training examples is expensive and has been shown to introduce annotation artifacts that neural models can readily exploit and overfit on. We investigate G-DAUG^C, a novel generative data augmentation method that aims to achieve more accurate and robust learning in the low-resource setting. Our approach generates synthetic examples using pretrained language models, and selects the most informative and diverse set of examples for data augmentation. In experiments with multiple commonsense reasoning benchmarks, G-DAUG^C consistently outperforms existing data augmentation methods based on back-translation, and establishes a new state-of-the-art on WinoGrande, CODAH, and CommonsenseQA. Further, in addition to improvements in in-distribution accuracy, G-DAUG^C-augmented training also enhances out-of-distribution generalization, showing greater robustness against adversarial or perturbed examples. Our analysis demonstrates that G-DAUG^C produces a diverse set of fluent training examples, and that its selection and training approaches are important for performance. Our findings encourage future research toward generative data augmentation to enhance both in-distribution learning and out-of-distribution generalization.


A Survey on the Explainability of Supervised Machine Learning

arXiv.org Machine Learning

Predictions obtained by, e.g., artificial neural networks have a high accuracy but humans often perceive the models as black boxes. Insights about the decision making are mostly opaque for humans. Particularly understanding the decision making in highly sensitive areas such as healthcare or fifinance, is of paramount importance. The decision-making behind the black boxes requires it to be more transparent, accountable, and understandable for humans. This survey paper provides essential definitions, an overview of the different principles and methodologies of explainable Supervised Machine Learning (SML). We conduct a state-of-the-art survey that reviews past and recent explainable SML approaches and classifies them according to the introduced definitions. Finally, we illustrate principles by means of an explanatory case study and discuss important future directions.


Meta Automatic Curriculum Learning

arXiv.org Artificial Intelligence

A major challenge in the Deep RL (DRL) community is to train agents able to generalize their control policy over situations never seen in training. Training on diverse tasks has been identified as a key ingredient for good generalization, which pushed researchers towards using rich procedural task generation systems controlled through complex continuous parameter spaces. In such complex task spaces, it is essential to rely on some form of Automatic Curriculum Learning (ACL) to adapt the task sampling distribution to a given learning agent, instead of randomly sampling tasks, as many could end up being either trivial or unfeasible. Since it is hard to get prior knowledge on such task spaces, many ACL algorithms explore the task space to detect progress niches over time, a costly tabula-rasa process that needs to be performed for each new learning agents, although they might have similarities in their capabilities profiles. To address this limitation, we introduce the concept of Meta-ACL, and formalize it in the context of black-box RL learners, i.e. algorithms seeking to generalize curriculum generation to an (unknown) distribution of learners. In this work, we present AGAIN, a first instantiation of Meta-ACL, and showcase its benefits for curriculum generation over classical ACL in multiple simulated environments including procedurally generated parkour environments with learners of varying morphologies. Videos and code are available at https://sites.google.com/view/meta-acl .


Conversational agents for learning foreign languages -- a survey

arXiv.org Artificial Intelligence

Conversational practice, while crucial for all language learners, can be challenging to get enough of and very expensive. Chatbots are computer programs developed to engage in conversations with humans. They are designed as software avatars with limited, but growing conversational capability. The most natural and potentially powerful application of chatbots is in line with their fundamental nature - language practice. However, their role and outcomes within (in)formal language learning are currently tangential at best. Existing research in the area has generally focused on chatbots' comprehensibility and the motivation they inspire in their users. In this paper, we provide an overview of the chatbots for learning languages, critically analyze existing approaches, and discuss the major challenges for future work.


Automatic selection of clustering algorithms using supervised graph embedding

arXiv.org Machine Learning

The widespread adoption of machine learning (ML) techniques and the extensive expertise required to apply them have led to increased interest in automated ML solutions that reduce the need for human intervention. One of the main challenges in applying ML to previously unseen problems is algorithm selection - the identification of high-performing algorithm(s) for a given dataset, task, and evaluation measure. This study addresses the algorithm selection challenge for data clustering, a fundamental task in data mining that is aimed at grouping similar objects. We present MARCO-GE, a novel meta-learning approach for the automated recommendation of clustering algorithms. MARCO-GE first transforms datasets into graphs and then utilizes a graph convolutional neural network technique to extract their latent representation. Using the embedding representations obtained, MARCO-GE trains a ranking meta-model capable of accurately recommending top-performing algorithms for a new dataset and clustering evaluation measure. Extensive evaluation on 210 datasets, 13 clustering algorithms, and 10 clustering measures demonstrates the effectiveness of our approach and its dominance in terms of predictive and generalization performance over state-of-the-art clustering meta-learning approaches.


Coarse-grained and emergent distributed parameter systems from data

arXiv.org Machine Learning

For example, For many systems of interest in physics or engineering, in the case of collective particle motion, a natural choice we are given a fine-scale description of the system evolution, for such an independent variable would be the coordinates e.g. at the particle-based or agent-based level; yet the system of the space in which the particles move, and the coarsegrained exhibits large-scale, coarse-grained, spatiotemporal patterns PDE would involve the spatial derivatives of some which may well be captured by a set of unknown effective, unknown, coarse dependent variables. We assume that these coarse-grained possibly emergent PDEs. Such reduced, effective unknown dependent variables capture the local collective PDEs, when they exist and can be derived (whether (possibly averaged) statistical features of the particles, and mathematically, or in a data-driven fashion) can serve as hence can be written in terms of the local particle distribution cheap surrogate models, drastically facilitating computationintensive observations. We use manifold learning to extract tasks like prediction, optimization, uncertainty these coarse nonlinear observables from mining local particle quantification and even control.