Deep Learning
BAR: Bayesian Activity Recognition using variational inference
Krishnan, Ranganath, Subedar, Mahesh, Tickoo, Omesh
Uncertainty estimation in deep neural networks is essential for designing reliable and robust AI systems. Applications such as video surveillance for identifying suspicious activities are designed with deep neural networks (DNNs), but DNNs do not provide uncertainty estimates. Capturing reliable uncertainty estimates in safety and security critical applications will help to establish trust in the AI system. Our contribution is to apply Bayesian deep learning framework to visual activity recognition application and quantify model uncertainty along with principled confidence. We utilize the variational inference technique while training the Bayesian DNNs to infer the approximate posterior distribution around model parameters and perform Monte Carlo sampling on the posterior of model parameters to obtain the predictive distribution. We show that the Bayesian inference applied to DNNs provides reliable confidence measures for visual activity recognition task as compared to the conventional DNNs. We also show that our method improves the visual activity recognition precision-recall score by 6% compared to non-Bayesian baseline. We evaluate our models on Moments-In-Time (MiT) activity recognition dataset by selecting a subset of in- and out-of-distribution video samples.
An Optimal Transport View on Generalization
Zhang, Jingwei, Liu, Tongliang, Tao, Dacheng
We derive upper bounds on the generalization error of learning algorithms based on their \emph{algorithmic transport cost}: the expected Wasserstein distance between the output hypothesis and the output hypothesis conditioned on an input example. The bounds provide a novel approach to study the generalization of learning algorithms from an optimal transport view and impose less constraints on the loss function, such as sub-gaussian or bounded. We further provide several upper bounds on the algorithmic transport cost in terms of total variation distance, relative entropy (or KL-divergence), and VC dimension, thus further bridging optimal transport theory and information theory with statistical learning theory. Moreover, we also study different conditions for loss functions under which the generalization error of a learning algorithm can be upper bounded by different probability metrics between distributions relating to the output hypothesis and/or the input data. Finally, under our established framework, we analyze the generalization in deep learning and conclude that the generalization error in deep neural networks (DNNs) decreases exponentially to zero as the number of layers increases. Our analyses of generalization error in deep learning mainly exploit the hierarchical structure in DNNs and the contraction property of $f$-divergence, which may be of independent interest in analyzing other learning models with hierarchical structure.
Finding and Following of Honeycombing Regions in Computed Tomography Lung Images by Deep Learning
Eฤriboz, Emre, Kaynar, Furkan, Albayrak, Songรผl Varli, Mรผsellim, Benan, Selรงuk, Tuba
In recent years, besides the medical treatment methods in medical field, Computer Aided Diagnosis (CAD) systems which can facilitate the decision making phase of the physician and can detect the disease at an early stage have started to be used frequently. The diagnosis of Idiopathic Pulmonary Fibrosis (IPF) disease by using CAD systems is very important in that it can be followed by doctors and radiologists. It has become possible to diagnose and follow up the disease with the help of CAD systems by the development of high resolution computed imaging scanners and increasing size of computation power. The purpose of this project is to design a tool that will help specialists diagnose and follow up the IPF disease by identifying areas of honeycombing and ground glass patterns in High Resolution Computed Tomography (HRCT) lung images. Creating a program module that segments the lung pair and creating a self-learner deep learning model from given Computed Tomography (CT) images for the specific diseased regions thanks to doctors are the main purposes of this work. Through the created model, program module will be able to find special regions in given new CT images. In this study, the performance of lung segmentation was tested by the S{\o}rensen-Dice coefficient method and the mean performance was measured as 90.7%, testing of the created model was performed with data not used in the training stage of the CNN network, and the average performance was measured as 87.8% for healthy regions, 73.3% for ground-glass areas and 69.1% for honeycombing zones.
A Comparison of Lattice-free Discriminative Training Criteria for Purely Sequence-Trained Neural Network Acoustic Models
In this work, three lattice-free (LF) discriminative training criteria for purely sequence-trained neural network acoustic models are compared on LVCSR tasks, namely maximum mutual information (MMI), boosted maximum mutual information (bMMI) and state-level minimum Bayes risk (sMBR). We demonstrate that, analogous to LF-MMI, a neural network acoustic model can also be trained from scratch using LF-bMMI or LF-sMBR criteria respectively without the need of cross-entropy pre-training. Furthermore, experimental results on Switchboard-300hrs and Switchboard+Fisher-2100hrs datasets show that models trained with LF-bMMI consistently outperform those trained with plain LF-MMI and achieve a relative word error rate (WER) reduction of 5% over competitive temporal convolution projected LSTM (TDNN-LSTMP) LF-MMI baselines.
Modular Architecture for StarCraft II with Deep Reinforcement Learning
Lee, Dennis, Tang, Haoran, Zhang, Jeffrey O, Xu, Huazhe, Darrell, Trevor, Abbeel, Pieter
We present a novel modular architecture for StarCraft II AI. The architecture splits responsibilities between multiple modules that each control one aspect of the game, such as build-order selection or tactics. A centralized scheduler reviews macros suggested by all modules and decides their order of execution. An updater keeps track of environment changes and instantiates macros into series of executable actions. Modules in this framework can be optimized independently or jointly via human design, planning, or reinforcement learning. We apply deep reinforcement learning techniques to training two out of six modules of a modular agent with self-play, achieving 94% or 87% win rates against the "Harder" (level 5) built-in Blizzard bot in Zerg vs. Zerg matches, with or without fog-of-war.
App may give early detection of autism using Artificial Intelligence
A new app using artificial intelligence might be able to help detect autism in children earlier in their lives. A duo of lecturers at the Manukau Institute of Technology (MIT) have created the app that uses deep learning technology to identify autistic traits. Autism is a neurodevelopmental condition that affects cognitive, sensory, and social processing, changing the way people see the world and interact with others. Dr Fadi Fayez says the Autism AI (artificial intelligence) app asks 10 questions across four age groups - toddlers, children, adolescents and adults. READ MORE: * Artificial intelligence knows what you'll choose before you've made up your mind * Artificial intelligence is changing our lives and now is the time to decide how * This optical illusion could help diagnose people with autism * Women are being diagnosed with autism later in life An artificial neural network method processes the answers and shows whether to pursue a formal clinical diagnosis.
AWS, Veritone: Machine Learning, AI Can Help Monetize Ads, Content
Machine learning (ML) and artificial intelligence can be used by media and entertainment (M&E) companies to help them monetize broadcast ads and content, according to Amazon Web Services (AWS) and Veritone. "At Amazon, we have been making investments in machine learning for many years," Christopher Kuthan, AWS business development lead for Media Industry Solutions, said Nov. 6 during the webinar "Monetize Media Broadcast Ads & Content with Machine Learning" (ML). "Customers' experiences at Amazon are driven through machine learning capabilities," including its supply chain forecasting, fulfillment and logistics, he told listeners. Its new drone initiative is "driven by deep learning and machine learning capabilities" also, he said, noting the company has "thousands of enginesโฆthat are committed to machine learning and deep learning, and it's really a deep part of our heritage." A wide range of Amazon customers and partners are now using ML on the AWS platform, he noted.
Data Science Machine Learning Deep Learning THAT-A-SCIENCE
Knowledge of AI and the ability to apply it to real world problems is highly important. AI has certainly become the new electricity. Certainly, knowing theory is not enough because until it is applied for business use cases it's not reaching its fullest potential. Hence learning AI concepts is important today but even more important is to apply them to real life situations. This is the age of AI.
Artificial intelligence may fall short when analyzing data across multiple health systems
Artificial intelligence (AI) tools trained to detect pneumonia on chest X-rays suffered significant decreases in performance when tested on data from outside health systems, according to a study conducted at the Icahn School of Medicine at Mount and published in a special issue of PLOS Medicine on machine learning and health care. These findings suggest that artificial intelligence in the medical space must be carefully tested for performance across a wide range of populations; otherwise, the deep learning models may not perform as accurately as expected. As interest in the use of computer system frameworks called convolutional neural networks (CNN) to analyze medical imaging and provide a computer-aided diagnosis grows, recent studies have suggested that AI image classification may not generalize to new data as well as commonly portrayed. Researchers at the Icahn School of Medicine at Mount Sinai assessed how AI models identified pneumonia in 158,000 chest X-rays across three medical institutions: the National Institutes of Health; The Mount Sinai Hospital; and Indiana University Hospital. Researchers chose to study the diagnosis of pneumonia on chest X-rays for its common occurrence, clinical significance, and prevalence in the research community.
Artificial intelligence predicts Alzheimer's years before diagnosis
IMAGE: Example of fluorine 18 fluorodeoxyglucose PET images from Alzheimer's Disease Neuroimaging Initiative set preprocessed with the grid method for patients with Alzheimer disease (AD). One representative zoomed-in section was provided... view more OAK BROOK, Ill. - Artificial intelligence (AI) technology improves the ability of brain imaging to predict Alzheimer's disease, according to a study published in the journal Radiology. Timely diagnosis of Alzheimer's disease is extremely important, as treatments and interventions are more effective early in the course of the disease. However, early diagnosis has proven to be challenging. Research has linked the disease process to changes in metabolism, as shown by glucose uptake in certain regions of the brain, but these changes can be difficult to recognize.