Education
How APIs Breathe Life Into Machine Learning Organisations
"API monetisation and API first strategies have become a new normal with businesses with digital maturity." The niche markets found even more niche business opportunities, thanks to the widespread adoption and development of APIs (Application Programming Interface). In their most basic form, APIs are doorways between two software applications and become extremely powerful when tailored to the needs of the developers. Web, mobile and automation are some of the key applications powered by APIs. According to a report by Google Cloud, API programs are the core drivers of digital transformation by playing a significant role in digital experiences, business operations, innovation, and growth.
Robo-writers: the rise and risks of language-generating AI
In June 2020, a new and powerful artificial intelligence (AI) began dazzling technologists in Silicon Valley. Called GPT-3 and created by the research firm OpenAI in San Francisco, California, it was the latest and most powerful in a series of'large language models': AIs that generate fluent streams of text after imbibing billions of words from books, articles and websites. GPT-3 had been trained on around 200 billion words, at an estimated cost of tens of millions of dollars. The developers who were invited to try out GPT-3 were astonished. "I have to say I'm blown away," wrote Arram Sabeti, founder of a technology start-up who is based in Silicon Valley. "It's far more coherent than any AI language system I've ever tried. All you have to do is write a prompt and it'll add text it thinks would plausibly follow. I've gotten it to write songs, stories, press releases, guitar tabs, interviews, essays, technical manuals. I feel like I've seen the future."
Continuous Coordination As a Realistic Scenario for Lifelong Learning
Nekoei, Hadi, Badrinaaraayanan, Akilesh, Courville, Aaron, Chandar, Sarath
Current deep reinforcement learning (RL) algorithms are still highly task-specific and lack the ability to generalize to new environments. Lifelong learning (LLL), however, aims at solving multiple tasks sequentially by efficiently transferring and using knowledge between tasks. Despite a surge of interest in lifelong RL in recent years, the lack of a realistic testbed makes robust evaluation of LLL algorithms difficult. Multi-agent RL (MARL), on the other hand, can be seen as a natural scenario for lifelong RL due to its inherent non-stationarity, since the agents' policies change over time. In this work, we introduce a multi-agent lifelong learning testbed that supports both zero-shot and few-shot settings. Our setup is based on Hanabi -- a partially-observable, fully cooperative multi-agent game that has been shown to be challenging for zero-shot coordination. Its large strategy space makes it a desirable environment for lifelong RL tasks. We evaluate several recent MARL methods, and benchmark state-of-the-art LLL algorithms in limited memory and computation regimes to shed light on their strengths and weaknesses. This continual learning paradigm also provides us with a pragmatic way of going beyond centralized training which is the most commonly used training protocol in MARL. We empirically show that the agents trained in our setup are able to coordinate well with unseen agents, without any additional assumptions made by previous works.
Continual Learning using a Bayesian Nonparametric Dictionary of Weight Factors
Mehta, Nikhil, Liang, Kevin J, Verma, Vinay K, Carin, Lawrence
Naively trained neural networks tend to experience catastrophic forgetting in sequential task settings, where data from previous tasks are unavailable. A number of methods, using various model expansion strategies, have been proposed recently as possible solutions. However, determining how much to expand the model is left to the practitioner, and often a constant schedule is chosen for simplicity, regardless of how complex the incoming task is. Instead, we propose a principled Bayesian nonparametric approach based on the Indian Buffet Process (IBP) prior, letting the data determine how much to expand the model complexity. We pair this with a factorization of the neural network's weight matrices. Such an approach allows the number of factors of each weight matrix to scale with the complexity of the task, while the IBP prior encourages sparse weight factor selection and factor reuse, promoting positive knowledge transfer between tasks. We demonstrate the effectiveness of our method on a number of continual learning benchmarks and analyze how weight factors are allocated and reused throughout the training.
Representation Matters: Assessing the Importance of Subgroup Allocations in Training Data
Rolf, Esther, Worledge, Theodora, Recht, Benjamin, Jordan, Michael I.
Datasets play a critical role in shaping the perception of performance and progress in machine learning (ML)--the way we collect, process, and analyze data affects the way we benchmark success and form new research agendas (Paullada et al., 2020; Dotan & Milli, 2020). A growing appreciation of this determinative role of datasets has sparked a concomitant concern that standard datasets used for training and evaluating ML models lack diversity along significant dimensions, for example, geography, gender, and skin type (Shankar et al., 2017; Buolamwini & Gebru, 2018). Lack of diversity in evaluation data can obfuscate disparate performance when evaluating based on aggregate accuracy (Buolamwini & Gebru, 2018). Lack of diversity in training data can limit the extent to which learned models can adequately apply to all portions of a population, a concern highlighted in recent work in the medical domain (Habib et al., 2019; Hofmanninger et al., 2020). Our work aims to develop a general unifying perspective on the way that dataset composition affects outcomes of machine learning systems.
Of Moments and Matching: Trade-offs and Treatments in Imitation Learning
Swamy, Gokul, Choudhury, Sanjiban, Wu, Zhiwei Steven, Bagnell, J. Andrew
We provide a unifying view of a large family of previous imitation learning algorithms through the lens of moment matching. At its core, our classification scheme is based on whether the learner attempts to match (1) reward or (2) action-value moments of the expert's behavior, with each option leading to differing algorithmic approaches. By considering adversarially chosen divergences between learner and expert behavior, we are able to derive bounds on policy performance that apply for all algorithms in each of these classes, the first to our knowledge. We also introduce the notion of recoverability, implicit in many previous analyses of imitation learning, which allows us to cleanly delineate how well each algorithmic family is able to mitigate compounding errors. We derive two novel algorithm templates, AdVIL and AdRIL, with strong guarantees, simple implementation, and competitive empirical performance.
Lifelong Learning based Disease Diagnosis on Clinical Notes
Wang, Zifeng, Yang, Yifan, Wen, Rui, Chen, Xi, Huang, Shao-Lun, Zheng, Yefeng
Current deep learning based disease diagnosis systems usually fall short in catastrophic forgetting, i.e., directly fine-tuning the disease diagnosis model on new tasks usually leads to abrupt decay of performance on previous tasks. What is worse, the trained diagnosis system would be fixed once deployed but collecting training data that covers enough diseases is infeasible, which inspires us to develop a lifelong learning diagnosis system. In this work, we propose to adopt attention to combine medical entities and context, embedding episodic memory and consolidation to retain knowledge, such that the learned model is capable of adapting to sequential disease-diagnosis tasks. Moreover, we establish a new benchmark, named Jarvis-40, which contains clinical notes collected from various hospitals. Experiments show that the proposed method can achieve state-of-the-art performance on the proposed benchmark. Code is available at https://github.com/yifyang/
Andrei Papancea, CEO at NLX โ Interview Series
Andrei Papancea, is the CEO at NLX a comprehensive SaaS platform for building and managing AI-powered conversational applications at scale. Previously, he built the Natural Language Understanding platform for American Express, processing millions of conversations across AmEx's main servicing channels. You grew up in Romania and started programming when you were 10 years old. What attracted you to programming at such a young age? It started off as curiosity: I've always been intrigued about how things worked and since my family has just gotten a computer, I wanted to figure out how it worked.
Learn Machine Learning With Real World Project S1
Description Data Science is rapidly growing to occupy all the industries of the world today. Medicine and healthcare are two of the most important part of our human lives. Traditionally, medicine solely relied on the discretion advised by the doctors. For example, a doctor would have to suggest suitable treatments based on a patient's symptoms. However, this wasn't always correct and was prone to human errors.
Artificial Neural Networks for Business Managers in R Studio
You're looking for a complete Artificial Neural Network (ANN) course that teaches you everything you need to create a Neural Network model in R, right? You've found the right Neural Networks course! Identify the business problem which can be solved using Neural network Models. Have a clear understanding of Advanced Neural network concepts such as Gradient Descent, forward and Backward Propagation etc. Create Neural network models in R using Keras and Tensorflow libraries and analyze their results. How this course will help you?