Goto

Collaborating Authors

 Deep Learning


Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs

arXiv.org Machine Learning

Advancements in gesture recognition algorithms have led to a significant growth in sign language translation. By making use of efficient intelligent models, signs can be recognized with precision. The proposed work presents a novel one-dimensional Convolutional Neural Network (CNN) array architecture for recognition of signs from the Indian sign language using signals recorded from a custom designed wearable IMU device. The IMU device makes use of tri-axial accelerometer and gyroscope. The signals recorded using the IMU device are segregated on the basis of their context, such as whether they correspond to signing for a general sentence or an interrogative sentence. The array comprises of two individual CNNs, one classifying the general sentences and the other classifying the interrogative sentence. Performances of individual CNNs in the array architecture are compared to that of a conventional CNN classifying the unsegregated dataset. Peak classification accuracies of 94.20% for general sentences and 95.00% for interrogative sentences achieved with the proposed CNN array in comparison to 93.50% for conventional CNN assert the suitability of the proposed approach.


A Universal Approximation Theorem of Deep Neural Networks for Expressing Distributions

arXiv.org Machine Learning

This paper studies the universal approximation property of deep neural networks for representing probability distributions. Given a target distribution $\pi$ and a source distribution $p_z$ both defined on $\mathbb{R}^d$, we prove under some assumptions that there exists a deep neural network $g:\mathbb{R}^d\rightarrow \mathbb{R}$ with ReLU activation such that the push-forward measure $(\nabla g)_\# p_z$ of $p_z$ under the map $\nabla g$ is arbitrarily close to the target measure $\pi$. The closeness are measured by three classes of integral probability metrics between probability distributions: $1$-Wasserstein distance, maximum mean distance (MMD) and kernelized Stein discrepancy (KSD). We prove upper bounds for the size (width and depth) of the deep neural network in terms of the dimension $d$ and the approximation error $\varepsilon$ with respect to the three discrepancies. In particular, the size of neural network can grow exponentially in $d$ when $1$-Wasserstein distance is used as the discrepancy, whereas for both MMD and KSD the size of neural network only depends on $d$ at most polynomially. Our proof relies on convergence estimates of empirical measures under aforementioned discrepancies and semi-discrete optimal transport.


Entropy-Based Modeling for Estimating Soft Errors Impact on Binarized Neural Network Inference

arXiv.org Machine Learning

Over past years, the easy accessibility to the large scale datasets has significantly shifted the paradigm for developing highly accurate prediction models that are driven from Neural Network (NN). These models can be potentially impacted by the radiation-induced transient faults that might lead to the gradual downgrade of the long-running expected NN inference accelerator. The crucial observation from our rigorous vulnerability assessment on the NN inference accelerator demonstrates that the weights and activation functions are unevenly susceptible to both single-event upset (SEU) and multi-bit upset (MBU), especially in the first five layers of our selected convolution neural network. In this paper, we present the relatively-accurate statistical models to delineate the impact of both undertaken SEU and MBU across layers and per each layer of the selected NN. These models can be used for evaluating the error-resiliency magnitude of NN topology before adopting them in the safety-critical applications.


Radiology: Artificial Intelligence

#artificialintelligence

In medicine, we often say that when you hear hoof beats, think horses, not zebras. The idea, of course, is that common diseases are common. Focusing on common diseases addresses those diseases that affect the most people. That's been a good plan in initial attempts to bring deep-learning systems to medicine. The NIH Chest Radiograph CXR14 data set, for example, focused on 14 common imaging findings.


Deploy your Custom AI Models on Azure Machine Learning Service

#artificialintelligence

Before I begin, let me tell you that this post is part of the Microsoft Student Partners Developer Stories initiative, and is based on the AI and ML Track. We will be exploring various Azure services - Azure Notebooks, Machine Learning Service, Container Instances and Container Registry. This post is beginner-friendly and can be used by anyone to deploy their machine learning models to Azure in a Standard format. Even high school kids are creating Machine Learning models these days, using popular machine learning frameworks like Keras, PyTorch, Caffe, etc. The model format created in one framework slightly differs with the model format created in the other.


Top Stories, Apr 13-19: Can Java Be Used for Machine Learning and Data Science?; How Deep Learning is Accelerating Drug Discovery in Pharmaceuticals - KDnuggets

#artificialintelligence

Also: Peer Reviewing Data Science Projects; Visualizing Decision Trees with Python (Scikit-learn, Graphviz, Matplotlib); Can Java Be Used for Machine Learning and Data Science?; Mathematics for Machine Learning: The Free eBook; 24 Best (and Free) Books To Understand Machine Learning


Future of AI Part 2

#artificialintelligence

This part of the series looks at the future of AI with much of the focus in the period after 2025. The leading AI researcher, Geoff Hinton, stated that it is very hard to predict what advances AI will bring beyond five years, noting that exponential progress makes the uncertainty too great. This article will therefore consider both the opportunities as well as the challenges that we will face along the way across different sectors of the economy. It is not intended to be exhaustive. Machine Learning is defined as the field of AI that applies statistical methods to enable computer systems to learn from the data towards an end goal. The term was introduced by Arthur Samuel in 1959. Deep Learning refers to the field of Neural Networks with several hidden layers. Such a neural network is often referred to as a deep neural network. Neural Networks are biologically inspired networks that extract abstract features from the data in a hierarchical fashion. Deep Reinforcement Learning will be considered in greater detail in part 3 of this series. For the purpose of this article I will consider AI to cover Machine Learning and Deep Learning. Narrow AI: the field of AI where the machine is designed to perform a single task and the machine gets very good at performing that particular task.


How deep learning can help scientific research

#artificialintelligence

This article is part of our reviews of AI research papers, a series of posts that explore the latest findings in artificial intelligence. Whether we take it for granted or not, deep learning algorithms have become an inseparable part of our daily lives. Personalized feeds, face and voice recognition, web search, smart speakers, digital assistants, email, and many other applications that we can't part ways with use deep learning algorithms under the hood. But how effective is deep learning in scientific research, where problems are often much more complex than classifying an image and requirements are much more sensitive than recommending what to buy next? To answer this question, former Google CEO Eric Schmidt and Google AI researcher Maithra Raghu have put together a comprehensive guide on the different deep learning techniques and their application to scientific research.


Microsoft Unveils Falcon To Secure Computation of AI Models

#artificialintelligence

Researchers from Microsoft, Princeton University, Technion and Algorand Foundation recently introduced a new framework known as Falcon. Falcon is an end-to-end 3-party protocol that can be used for fast and secure computations of deep learning algorithms on larger networks. Today, a vast amount of private data and sensitive information is continuously being generated. According to the researchers, combining this data with deep learning algorithms can transform the current social and technological scenario. Falcon is a deep learning framework that provides support for both training and inference with malicious security guarantees.


Purpose of different layers in a Deep Learning Model

#artificialintelligence

In this article, we have explored the significance or purpose or importance of each layer in a Machine Learning model. Different layers include convolution, pooling, normalization and much more. For example: the significance of MaxPool is that it decreases sensitivity to the location of features. We will go through each layer and explore its significance accordingly. Layers are the deep of deep learning!