Deep Learning
Neuroscience Breakthrough: AI Translates Thought-to-Speech
First there was the keyboard, then touch and voice to control computing devices and apps. Researchers at the Mortimer B. Zuckerman Mind Brain Behavior Institute at Columbia University in New York City announced "a scientific first" with their invention of a brain-computer interface (BCI) that translate human thought into speech with higher clarity and precision than existing solutions. The research team, led by Nima Mesgarani, Ph.D., published their findings on January 29, 2019 in Scientific Reports, a Nature research journal. A brain-computer interface is a bidirectional communication route between a brain and computer. Many BCI research projects are centered on neuroprosthetic uses for those who have lost or impaired movement, vision, hearing, or speech, such as those impacted by stroke, spinal cord injuries, amyotrophic lateral sclerosis (ALS), aphasia (speech impairment due to brain damage), cochlear damage, and locked-in syndrome.
PyTorch item: Convert A 0-dim PyTorch Tensor To A Python Number
This video will show you how to use PyTorch's item operation to convert a zero-dimensional PyTorch tensor to a Python number. Then we check what version of PyTorch we are using. We are using PyTorch 0.4.1. Let's create a zero-dimensional PyTorch tensor. Notice that we are not putting the 10 inside of brackets.
NeuNetS: Automating Neural Network Model Synthesis for Broader Adoption of AI - IBM Blog Research
On December 14, 2018, IBM released NeuNetS, a fundamentally new capability that addresses the skills gap for the development of latest AI models for a wide range of business domains. NeuNetS uses AI to automatically synthesize deep neural network models faster and easier than ever before, scaling up the adoption of AI by companies and SMEs. By fully automating AI model development and deployment, NeuNetS allows non-expert users to build neural networks for specific tasks and datasets in a fraction of the time it takes today--without sacrificing accuracy. AI is changing the way businesses work and innovate. Artificial neural networks are arguably the most powerful tool currently available to data scientists.
Last Week in AI – Jesus Rodriguez – Medium
Every week, my team at Invector Labs publishes a newsletter to track the most recent developments in AI research and technology. You can find this week's issue below. You can sign up for it below. Can AI models be hacked or manipulated by bad actors? Generative adversarial neural networks(GANs) is a prominent AI technique in which two neural networks compete against each other in order to improve knowledge.
The Natural Language of Actions
Tennenholtz, Guy, Mannor, Shie
We introduce Act2Vec, a general framework for learning context-based action representation for Reinforcement Learning. Representing actions in a vector space help reinforcement learning algorithms achieve better performance by grouping similar actions and utilizing relations between different actions. We show how prior knowledge of an environment can be extracted from demonstrations and injected into action vector representations that encode natural compatible behavior. We then use these for augmenting state representations as well as improving function approximation of Q-values. We visualize and test action embeddings in three domains including a drawing task, a high dimensional navigation task, and the large action space domain of StarCraft II.
Real-Time Steganalysis for Stream Media Based on Multi-channel Convolutional Sliding Windows
Yang, Zhongliang, Yang, Hao, Hu, Yuting, Huang, Yongfeng, Zhang, Yu-Jin
Previous VoIP steganalysis methods face great challenges in detecting speech signals at low embedding rates, and they are also generally difficult to perform real-time detection, making them hard to truly maintain cyberspace security. To solve these two challenges, in this paper, combined with the sliding window detection algorithm and Convolution Neural Network we propose a real-time VoIP steganalysis method which based on multi-channel convolution sliding windows. In order to analyze the correlations between frames and different neighborhood frames in a VoIP signal, we define multi channel sliding detection windows. Within each sliding window, we design two feature extraction channels which contain multiple convolution layers with multiple convolution kernels each layer to extract correlation features of the input signal. Then based on these extracted features, we use a forward fully connected network for feature fusion. Finally, by analyzing the statistical distribution of these features, the discriminator will determine whether the input speech signal contains covert information or not.We designed several experiments to test the proposed model's detection ability under various conditions, including different embedding rates, different speech length, etc. Experimental results showed that the proposed model outperforms all the previous methods, especially in the case of low embedding rate, which showed state-of-the-art performance. In addition, we also tested the detection efficiency of the proposed model, and the results showed that it can achieve almost real-time detection of VoIP speech signals.
Learning to Prescribe Interventions for Tuberculosis Patients using Digital Adherence Data
Killian, Jackson A., Wilder, Bryan, Sharma, Amit, Choudhary, Vinod, Dilkina, Bistra, Tambe, Milind
Digital Adherence Technologies (DATs) are an increasingly popular method for verifying patient adherence to many medications. We analyze data from one city served by 99DOTS, a phone-call-based DAT deployed for Tuberculosis (TB) treatment in India where nearly 3 million people are afflicted with the disease each year. The data contains nearly 17,000 patients and 2.1M phone calls. We lay the groundwork for learning from this real-world data, including a method for avoiding the effects of unobserved interventions in training data used for machine learning. We then construct a deep learning model, demonstrate its interpretability, and show how it can be adapted and trained in three different clinical scenarios to better target and improve patient care. In the real-time risk prediction setting our model could be used to proactively intervene with 21% more patients and before 76% more missed doses than current heuristic baselines. For outcome prediction, our model performs 40% better than baseline methods, allowing cities to target more resources to clinics with a heavier burden of patients at risk of failure. Finally, we present a case study demonstrating how our model can be trained in an end-to-end decision focused learning setting to achieve 15% better solution quality in an example decision problem faced by health workers.
Realistic Image Generation using Region-phrase Attention
Huang, Wanming, Xu, Yida, Oppermann, Ian
The Generative Adversarial Network (GAN) has recently been applied to generate synthetic images from text. Despite significant advances, most current state-of-the-art algorithms are regular-grid region based; when attention is used, it is mainly applied between individual regular-grid regions and a word. These approaches are sufficient to generate images that contain a single object in its foreground, such as a "bird" or "flower". However, natural languages often involve complex foreground objects and the background may also constitute a variable portion of the generated image. Therefore, the regular-grid based image attention weights may not necessarily concentrate on the intended foreground region(s), which in turn, results in an unnatural looking image. Additionally, individual words such as "a", "blue" and "shirt" do not necessarily provide a full visual context unless they are applied together. For this reason, in our paper, we proposed a novel method in which we introduced an additional set of attentions between true-grid regions and word phrases. The true-grid region is derived using a set of auxiliary bounding boxes. These auxiliary bounding boxes serve as superior location indicators to where the alignment and attention should be drawn with the word phrases. Word phrases are derived from analysing Part-of-Speech (POS) results. We perform experiments on this novel network architecture using the Microsoft Common Objects in Context (MSCOCO) dataset and the model generates $256 \times 256$ conditioned on a short sentence description. Our proposed approach is capable of generating more realistic images compared with the current state-of-the-art algorithms.
Object Detection and 3D Estimation via an FMCW Radar Using a Fully Convolutional Network
Zhang, Guoqiang, Li, Haopeng, Wenger, Fabian
Typical sensors for object detection include cameras, radars,and LiDARs. In general, different sensors have their unique sensing properties, which brings each type of sensor an advantage overothers when performing object detection. For instance, cameras are able to capture rich texture information of objects in normal light conditions, which makes it possible to identify and distinguish objectsfrom background. Radars attempt to detect objects by continuously transmitting microwaves and then analyzing the received signalsreflected by the objects, which allow the sensors to work regardless of bad weather conditions or dark environments. In recent years, object detection based on cameras has made significant progressby using deep learning framework. The basic idea is to design and train a deep neural network (DNN) by feeding a large number of annotated image samples. The training process enables theDNN to effectively capture informative image features of interested objects via multiple neural layers [2]. As a result, the trained DNN is able to produce impressive performance for visual object detection and other similar tasks such as object classification and segmentation (e.g., Mask R-CNN [3], YOLO [4], and U-Net [5]). Researchon exploiting DNNs for analyzing radar signals is still at an early stage.
WideDTA: prediction of drug-target binding affinity
Öztürk, Hakime, Ozkirimli, Elif, Özgür, Arzucan
Motivation: Prediction of the interaction affinity between proteins and compounds is a major challenge in the drug discovery process. WideDTA is a deep-learning based prediction model that employs chemical and biological textual sequence information to predict binding affinity. Results: WideDTA uses four text-based information sources, namely the protein sequence, ligand SMILES, protein domains and motifs, and maximum common substructure words to predict binding affinity. WideDTA outperformed one of the state of the art deep learning methods for drug-target binding affinity prediction, DeepDTA on the KIBA dataset with a statistical significance. This indicates that the word-based sequence representation adapted by WideDTA is a promising alternative to the character-based sequence representation approach in deep learning models for binding affinity prediction, such as the one used in DeepDTA. In addition, the results showed that, given the protein sequence and ligand SMILES, the inclusion of protein domain and motif information as well as ligand maximum common substructure words do not provide additional useful information for the deep learning model. Interestingly, however, using only domain and motif information to represent proteins achieved similar performance to using the full protein sequence, suggesting that important binding relevant information is contained within the protein motifs and domains.