Deep Learning
Democratization of Deep Learning Using DARVIZ
Sankaran, Anush (IBM Research AI) | Panwar, Naveen (IBM Research AI) | Khare, Shreya (IBM Research AI) | Mani, Senthil (IBM Research AI) | Sethi, Akshay (IIIT Delhi) | Aralikatte, Rahul (IBM Research AI) | Gantayat, Neelamadhav (IBM Research AI)
With an abundance of research papers in deep learning, adoption and reproducibility of existing works becomes a challenge. To make a DL developer life easy, we propose a novel system, DARVIZ, to visually design a DL model using a drag-and-drop framework in an platform agnostic manner. The code could be automatically generated in both Caffe and Keras. DARVIZ could import (i) any existing Caffe code, or (ii) a research paper containing a DL design; extract the design, and present it in visual editor.
Vertical Domain Text Classification: Towards Understanding IT Tickets Using Deep Neural Networks
Han, Jianglei (SAP) | Akbari, Mohammad (Nanyang Technological University)
It is challenging to directly apply text classification models without much feature engineering on domain-specific use cases, and expect the state of art performance. Much more so when the number of classes is large. Convolutional Neural Network (CNN or Con-vNet) has attracted much in text mining due to its effectiveness in automatic feature extraction from text. In this paper, we compare traditional and deep learning approaches for automatic categorization of IT tickets in a real-world production ticketing system. Experimental results demonstrate the good potential of CNN models in our task.
Generative Adversarial Networks and Probabilistic Graph Models for Hyperspectral Image Classification
Zhong, Zilong (University of Waterloo) | Li, Jonathan (University of Waterloo)
High spectral dimensionality and the shortage of annotations make hyperspectral image (HSI) classification a challenging problem. Recent studies suggest that convolutional neural networks can learn discriminative spatial features, which play a paramount role in HSI interpretation. However, most of these methods ignore the distinctive spectral-spatial characteristic of hyperspectral data. In addition, a large amount of unlabeled data remains an unexploited gold mine for efficient data use. Therefore, we proposed an integration of generative adversarial networks (GANs) and probabilistic graphical models for HSI classification. Specifically, we used a spectral-spatial generator and a discriminator to identify land cover categories of hyperspectral cubes. Moreover, to take advantage of a large amount of unlabeled data, we adopted a conditional random field to refine the preliminary classification results generated by GANs. Experimental results obtained using two commonly studied datasets demonstrate that the proposed framework achieved encouraging classification accuracy using a small number of data for training.
Personalized Human Activity Recognition Using Convolutional Neural Networks
Rokni, Seyed Ali (Washington State University) | Nourollahi, Marjan (Washington State University) | Ghasemzadeh, Hassan (Washington State University)
Because the sensor captures human accelerations continuously Inertial wearable sensors have been vastly utilized for Human while the subject performs different activities in freeliving Activity Recognition (HAR). A major challenge with situations, 'start' and'end' of activities are unknown the trained HAR models is that the performance of the classifier a priori. A typical segmentation with a window of size w is highly sensitive to the context of the sensor and engineered on 3-axis accelerometer data forms 3 channels of input data, features (Rokni and Ghasemzadeh 2017).
Rating Super-Resolution Microscopy Images With Deep Learning
Robitaille, Louis-Émile (Université Laval) | Durand, Audrey (Université Laval) | Gardner, Marc-André (Université Laval) | Gagné, Christian (Université Laval) | Koninck, Paul De (Université Laval) | Lavoie-Cardinal, Flavie (Université Laval)
In order to improve their understanding, cellular mechanisms to the imaging process, or the observability of specific structures. Superresolution we consider a network made of 6 convolutional layers microscopes are highly specialized devices, significantly and 2 fully connected layers. An ELU activation (Exponential more complex to use than conventional optical microscopes, Linear Unit) is used after each convolutional and fully hence reducing their accessibility. Max pooling (kernel 2x2, stride 1) is added overall quality of the obtained images can vary a lot depending after each convolutional unit. Batch normalization is applied on the imaging parameters or the biological structure of to all the layers except the first one.
Adversary Is the Best Teacher: Towards Extremely Compact Neural Networks
Prabhu, Ameya (International Institute of Information Technology, Hyderabad) | Krishna, Harish (International Institute of Information Technology, Hyderabad) | Saha, Soham (International Institute of Information Technology, Hyderabad)
Why is our contribution important to the community? The recent boom in deep neural networks has resulted in Learning without any explicit supervision for a task ipso their being used for a wide variety of applications, many of facto provides interesting properties to our approach. An example which find significance when run on memory-constrained is that the learning method is domain and task independent, environments. Popular methods for neural network compression since instead of learning a given task, we learn aim to achieve a reduction in the number of parameters a way to learn that from the teacher. Hence, it should be while retaining state-of-the-art results. A seminal work well suited to classification, retrieval, clustering or any other on model compression was by Hinton et al [2] who introduced method across domains. Another interesting fact about this a technique in which a small student network learns approach is that humans learn in a similar way too - they from a large teacher network that is trained to saturation.
Generative Adversarial Network for Abstractive Text Summarization
Liu, Linqing (Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences) | Lu, Yao (Alberta Machine Intelligence Institute) | Yang, Min (Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences) | Qu, Qiang (Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences) | Zhu, Jia (South China Normal University) | Li, Hongyan (Peking University)
In this paper, we propose an adversarial process for abstractive text summarization, in which we simultaneously train a generative model G and a discriminative model D. In particular, we build the generator G as an agent of reinforcement learning, which takes the raw text as input and predicts the abstractive summarization. We also build a discriminator which attempts to distinguish the generated summary from the ground truth summary. Extensive experiments demonstrate that our model achieves competitive ROUGE scores with the state-of-the-art methods on CNN/Daily Mail dataset. Qualitatively, we show that our model is able to generate more abstractive, readable and diverse summaries.
Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification
Lei, Zeyang (Tsinghua University) | Yang, Yujiu (Tsinghua University) | Yang, Min ( Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences )
Deep neural networks have gained great success recently for sentiment classification. However, these approaches do not fully exploit the linguistic knowledge. In this paper, we propose a novel sentiment lexicon enhanced attention-based LSTM (SLEA-LSTM) model to improve the performance of sentence-level sentiment classification. Our method successfully integrates sentiment lexicon into deep neural networks via single-head or multi-head attention mechanisms. We conduct extensive experiments on MR and SST datasets. The experimental results show that our model achieved comparable or better performance than the state-of-the-art methods.
Consonant-Vowel Sequences as Subword Units for Code-Mixed Languages
Kumar, Upendra (Indian Institute of Information Technology, Sri City, AP) | Singh, Vishal (Indian Institute of Information Technology, Sri City, AP) | Andrew, Chris (Indian Institute of Information Technology, Sri City, AP) | Reddy, Santhoshini (Indian Institute of Information Technology, Sri City, AP) | Das, Amitava (Indian Institute of Information Technology, Sri City, AP)
They used character n-grams as sub-word units that were obtained The evolution of social media texts such as blogs, microblogs as convolutions over characters and passed to a LSTM layer (e.g., Twitter), WhatsApp, and informal chats have followed by softmax layer. For Hi-En code-mixed text (Joshi created many new opportunities for information access and et al. 2016) address the problem of rare or out-of-vocabulary language technologies, but have also presented many new words without any text normalization. In this paper, we propose challenges. This makes it one of the primary research areas a novel approach, without any need of explicit text normalization, of the present era. In social media, non-English speakers for creating sub-word units and a new hierarchical [according to statistics half of messages on Twitter arent model that efficiently learns sentence representations in English (Schroeder, Minocha, and Schneider 2010)] from these units.
Identifying Emotional Support in Online Health Communities
Khanpour, Hamed (University of North Texas) | Caragea, Cornelia (Kansas State University) | Biyani, Prakhar (Oath Inc.)
Extracting emotional support in Online Health Communities provides insightful information about patients’ emotional states. Current computational approaches to identifying emotional messages, i.e., messages that contain emotional support, are typically based on a set of handcrafted features. In this paper, we show that high-level and abstract features derived from a combination of convolutional neural networks (CNN) with Long Short Term Memory (LSTM) networks can be successfully employed for emotional message identification and can obviate the need for handcrafted features.