Deep Learning
Digital Analytics
Invented by Geoffrey Hinton in 1985, Restricted Boltzmann Machine which falls under the category of unsupervised learning algorithms is a network of symmetrically connected neuron-like units that make stochastic decisions. This deep learning algorithm became very popular after the Netflix Competition where RBM was used as a collaborative filtering technique to predict user ratings for movies and beat most of its competition. It is useful for regression, classification, dimensionality reduction, feature learning, topic modelling and collaborative filtering. Restricted Boltzmann Machines are stochastic two layered neural networks which belong to a category of energy based models that can detect inherent patterns automatically in the data by reconstructing input. They have two layers visible and hidden.
Can Neural Networks Show Imagination? DeepMind Thinks They Can - KDnuggets
I recently started a new newsletter focus on AI education. TheSequence is a no-BS (meaning no hype, no news etc) AI-focused newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Creating agents that resemble the cognitive abilities of the human brain has been one of the most elusive goals of the artificial intelligence(AI) space. Recently, I've been spending time on a couple of scenarios that relate to imagination in deep learning systems which reminded me of a very influential paper Alphabet's subsidiary DeepMind published last year in this subject.
PyTorch: Deep Learning and Artificial Intelligence
Created by Lazy Programmer Inc. Students also bought Feature Engineering for Machine Learning Training YOLO v3 for Objects Detection with Custom Data The Complete Neural Networks Bootcamp: Theory, Applications Complete Tensorflow 2 and Keras Deep Learning Bootcamp Testing and Monitoring Machine Learning Model Deployments Preview this course GET COUPON CODE Welcome to PyTorch: Deep Learning and Artificial Intelligence! Although Google's Deep Learning library Tensorflow has gained massive popularity over the past few years, PyTorch has been the library of choice for professionals and researchers around the globe for deep learning and artificial intelligence. Is it possible that Tensorflow is popular only because Google is popular and used effective marketing? Why did Tensorflow change so significantly between version 1 and version 2? Was there something deeply flawed with it, and are there still potential problems? It is less well-known that PyTorch is backed by another Internet giant, Facebook (specifically, the Facebook AI Research Lab - FAIR).
MIT Introduction to Deep Learning
Guest post by MIT 6.S191 Introduction to Deep Learning MIT 6.S191: Introduction to Deep Learning is an introductory course offered formally at MIT and open-sourced on its course website. The class consists of a series of foundational lectures on the fundamentals of neural networks and their applications to sequence modeling, computer vision, generative models, and reinforcement learning.MIT's offi…
Create a skill with Alexa Conversations
Alexa Conversations, a new deep learning-based approach that developers can use for creating natural voice experiences on Alexa with less effort, fewer lines of code, and less training data than before. Alexa Conversations let's you create skills with more configuration and less coding. Come along to this workshop to learn how to build an Alexa Conversations skill and take skills to the next level with less effort. Attendees will receive an introduction to Alexa Conversations and create a simple skill to get started on your journey. You will also need to create an Amazon Alexa Developer account and an AWS account if you want to follow along.
Artificial intelligence system developed to help better select embryos for implantation
For many people who are struggling to conceive, in-vitro fertilization (IVF) can offer a life-changing solution. But the average success rate for IVF is only about 30 percent. Investigators from Brigham and Women's Hospital and Massachusetts General Hospital are developing an artificial intelligence system with the goal of improving IVF success by helping embryologists objectively select embryos most likely to result in a healthy birth. Using thousands of embryo image examples and deep-learning artificial intelligence (AI), the team developed a system that was able to differentiate and identify embryos with the highest potential for success significantly better than 15 experienced embryologists from five different fertility centers across the United States. Results of their study are published in eLife.
New data processing module makes deep neural networks smarter
"Feature normalization is a crucial element of training deep neural networks, and feature attention is equally important for helping networks highlight which features learned from raw data are most important for accomplishing a given task," says Tianfu Wu, corresponding author of a paper on the work and an assistant professor of electrical and computer engineering at NC State. "But they have mostly been treated separately. We found that combining them made them more efficient and effective." To test their AN module, the researchers plugged it into four of the most widely used neural network architectures: ResNets, DenseNets, MobileNetsV2 and AOGNets. They then tested the networks against two industry standard benchmarks: the ImageNet-1000 classification benchmark and the MS-COCO 2017 object detection and instance segmentation benchmark.
A Concept-based Abstraction-Aggregation Deep Neural Network for Interpretable Document Classification
Shi, Tian, Zhang, Xuchao, Wang, Ping, Reddy, Chandan K.
Using attention weights to identify information that is important for models' decision making is a popular approach to interpret attention-based neural networks, which is commonly realized via creating a heat-map for every single document based on attention weights. However, this interpretation method is fragile. In this paper, we propose a corpus-level explanation approach, which aims to capture causal relationships between keywords and model predictions via learning importance of keywords for predicted labels across a training corpus based on attention weights. Using this idea as the fundamental building block, we further propose a concept-based explanation method that can automatically learn higher-level concepts and their importance to model prediction task. Our concept-based explanation method is built upon a novel Abstraction-Aggregation Network, which can automatically cluster important keywords during an end-to-end training process. We apply these methods to the document classification task and show that they are powerful in extracting semantically meaningful keywords and concepts. Our consistency analysis results based on an attention-based Na\"ive Bayes Classifier also demonstrate these keywords and concepts are important for model predictions.
Deep Reinforcement Learning for Closed-Loop Blood Glucose Control
Fox, Ian, Lee, Joyce, Pop-Busui, Rodica, Wiens, Jenna
People with type 1 diabetes (T1D) lack the ability to produce the insulin their bodies need. As a result, they must continually make decisions about how much insulin to self-administer to adequately control their blood glucose levels. Longitudinal data streams captured from wearables, like continuous glucose monitors, can help these individuals manage their health, but currently the majority of the decision burden remains on the user. To relieve this burden, researchers are working on closed-loop solutions that combine a continuous glucose monitor and an insulin pump with a control algorithm in an `artificial pancreas.' Such systems aim to estimate and deliver the appropriate amount of insulin. Here, we develop reinforcement learning (RL) techniques for automated blood glucose control. Through a series of experiments, we compare the performance of different deep RL approaches to non-RL approaches. We highlight the flexibility of RL approaches, demonstrating how they can adapt to new individuals with little additional data. On over 2.1 million hours of data from 30 simulated patients, our RL approach outperforms baseline control algorithms: leading to a decrease in median glycemic risk of nearly 50% from 8.34 to 4.24 and a decrease in total time hypoglycemic of 99.8%, from 4,610 days to 6. Moreover, these approaches are able to adapt to predictable meal times (decreasing average risk by an additional 24% as meals increase in predictability). This work demonstrates the potential of deep RL to help people with T1D manage their blood glucose levels without requiring expert knowledge. All of our code is publicly available, allowing for replication and extension.