Deep Learning
OmicsMapNet: Transforming omics data to take advantage of Deep Convolutional Neural Network for discovery
We developed OmicsMapNet approach to take advantage of existing deep leaning frameworks to analyze high-dimensional omics data as 2-dimensional images. The omics data of individual samples were first rearranged into 2D images in which molecular features related in functions, ontologies, or other relationships were organized in spatially adjacent and patterned locations. Deep learning neural networks were trained to classify the images. Molecular features informative of classes of different phenotypes were subsequently identified. As an example, we used the KEGG BRITE database to rearrange RNA-Seq expression data of TCGA diffuse glioma samples as treemaps to capture the functional hierarchical structure of genes in 2D images. Deep Convolutional Neural Networks (CNN) were derived using tools from TensorFlow to learn the grade of TCGA LGG and GBM samples with relatively high accuracy. The most contributory features in the trained CNN were confirmed in pathway analysis for their plausible functional involvement.
Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond
Ouyang, Xi, Cheng, Yu, Jiang, Yifan, Li, Chun-Liang, Zhou, Pan
State-of-the-art pedestrian detection models have achieved great success in many benchmarks. However, these models require lots of annotation information and the labeling process usually takes much time and efforts. In this paper, we propose a method to generate labeled pedestrian data and adopt them to support the training of pedestrian detectors. The proposed framework is built on the Generative Adversarial Network (GAN) with multiple discriminators, trying to synthesize realistic pedestrians and learn the background context simultaneously. To handle the pedestrians of different sizes, we adopt the Spatial Pyramid Pooling (SPP) layer in the discriminator. We conduct experiments on two benchmarks. The results show that our framework can smoothly synthesize pedestrians on background images of variations and different levels of details. To quantitatively evaluate our approach, we add the generated samples into training data of the baseline pedestrian detectors and show the synthetic images are able to improve the detectors' performance.
Google deep learning audio-visual model can pinpoint one voice in many
Google says that people are very good at separating out other voices and hearing the one we are looking at, this is called the cocktail party effect. Google wants to make computers better at hearing the voice that we want to hear and has developed a new deep learning audio-visual model for isolating single speech signal from a mixture of sounds. That separation can be from other voices or from background sounds. Google says that thanks to this new model, it can computationally produce videos where the speech of specific people is enhanced while other sounds are suppressed. Google's method works on ordinary videos with a single audio track and all the user must do is select the face of the person in the video they want to hear.
Linux Foundation launches Deep Learning group, in AI unity push - Rethink
AI and machine-learning (ML) could be held back by lack of skills in building applications and applying the technology effectively if rate of deployment comes anywhere close to matching the rampant hype currently sweeping the field. There have already been reports of skills shortages and a drain of the best developers and data scientists away from academia and smaller emerging AI specialists towards the big players such as Google, Amazon and Facebook, as well as the Chinese, which are investing huge sums in their programs.
LEARNING PATH: TensorFlow: Complete Solutions to TensorFlow
TensorFlow has quickly become a popular choice of tool for performing fast, efficient, and accurate deep learning. This Learning Path presents the implementation of practical, real-world projects, teaching you how to leverage TensorFlow's capabilities to perform efficient deep learning. So, if you are interested to acquire complete knowledge on deep learning with TensorFlow, then you should surely go for this Learning Path. Packt's Video Learning Paths are a series of individual video products put together in a logical and stepwise manner such that each video builds on the skills learned in the video before it. Let's take a look at your learning journey.
Keras Deep Learning Projects Udemy
Keras is a deep learning library for fast, efficient training of deep learning models, and can also work with Tensorflow and Theano. Because it is lightweight and very easy to use, Keras has gained quite a lot of popularity in a very short time. This course will show you how to leverage the power of Keras to build and train high performance, high accuracy deep learning models, by implementing practical projects in real-world domains.Spanning over three hours, this course will help you master even the most advanced concepts in deep learning and how to implement them with Keras. You will train CNNs, RNNs, LSTMs, Autoencoders and Generative Adversarial Networks using real-world training datasets. These datasets will be from domains such as Image Processing and Computer Vision, Natural Language Processing, Reinforcement Learning and more.By the end of this highly practical course, you will be well-versed with deep learning and its implementation with Keras.
Google AI can pick out voices in a crowd
Humans are usually good at isolating a single voice in a crowd, but computers? Not so much -- just ask anyone trying to talk to a smart speaker at a house party. Google may have a surprisingly straightforward solution, however. Its researchers have developed a deep learning system that can pick out specific voices by looking at people's faces when they're speaking. The team trained its neural network model to recognize individual people speaking by themselves, and then created virtual "parties" (complete with background noise) to teach the AI how to isolate multiple voices into distinct audio tracks.
Scalable and Interpretable One-class SVMs with Deep Learning and Random Fourier features
Nguyen, Minh-Nghia, Vien, Ngo Anh
One-class Support Vector Machine (OC-SVM) for a long time has been one of the most effective anomaly detection methods and widely adopted in both research as well as industrial applications. The biggest issue for OC-SVM is, however, the capability to operate with large and high-dimensional datasets due to inefficient features and optimization complexity. Those problems might be mitigated via dimensionality reduction techniques such as manifold learning or auto-encoder. However, previous work often treats representation learning and anomaly prediction separately. In this paper, we propose autoencoder based one-class SVM (AE-1SVM) that brings OC-SVM, with the aid of random Fourier features to approximate the radial basis kernel, into deep learning context by combining it with a representation learning architecture and jointly exploit stochastic gradient descend to obtain end-to-end training. Interestingly, this also opens up the possible use of gradient-based attribution methods to explain the decision making for anomaly detection, which has ever been challenging as a result of the implicit mappings between the input space and the kernel space. To the best of our knowledge, this is the first work to study the interpretability of deep learning in anomaly detection. We evaluate our method on a wide range of unsupervised anomaly detection tasks in which our end-to-end training architecture achieves a performance significantly better than the previous work using separate training.
The unreasonable effectiveness of the forget gate
van der Westhuizen, Jos, Lasenby, Joan
Given the success of the gated recurrent unit, a natural question is whether all the gates of the long short-term memory (LSTM) network are necessary. Previous research has shown that the forget gate is one of the most important gates in the LSTM. Here we show that a forget-gate-only version of the LSTM with chrono-initialized biases, not only provides computational savings but outperforms the standard LSTM on multiple benchmark datasets and competes with some of the best contemporary models. Our proposed network, the JANET, achieves accuracies of 99% and 92.5% on the MNIST and pMNIST datasets, outperforming the standard LSTM which yields accuracies of 98.5% and 91%.
A Deep Learning Approach to Fast, Format-Agnostic Detection of Malicious Web Content
Saxe, Joshua, Harang, Richard, Wild, Cody, Sanders, Hillary
Malicious web content is a serious problem on the Internet today. In this paper we propose a deep learning approach to detecting malevolent web pages. While past work on web content detection has relied on syntactic parsing or on emulation of HTML and Javascript to extract features, our approach operates directly on a language-agnostic stream of tokens extracted directly from static HTML files with a simple regular expression. This makes it fast enough to operate in high-frequency data contexts like firewalls and web proxies, and allows it to avoid the attack surface exposure of complex parsing and emulation code. Unlike well-known approaches such as bag-of-words models, which ignore spatial information, our neural network examines content at hierarchical spatial scales, allowing our model to capture locality and yielding superior accuracy compared to bag-of-words baselines. Our proposed architecture achieves a 97.5% detection rate at a 0.1% false positive rate, and classifies small-batched web pages at a rate of over 100 per second on commodity hardware. The speed and accuracy of our approach makes it appropriate for deployment to endpoints, firewalls, and web proxies.