Goto

Collaborating Authors

 Deep Learning


Four Quadrants of the Enterprise AI business case

#artificialintelligence

We could initially model the problem as a machine learning or a deep learning problem. At this stage, we are concerned with the accuracy, choice and the efficiency of the model. Hence, the first quadrant is characterized by experimental analysis to prove value. We are also concerned with improving the existing KPIs. For example, if you are working with fraud detection or loan prediction – each of these applications has an existing KPI based on current techniques.


Understanding The Artificial Intelligence Trends in 2018 MarkTechPost

#artificialintelligence

The level of technological advancement and adoption of Artificial Intelligence in different business industries is incredible. Every firm is striving to integrate machine learning and smart services to enhance and boost production. There is more to business in 2018 than the conventional marketing techniques; apart from e-commerce where most transactions and purchases are made online, AI is rising in all nature of businesses. Top companies like Google, Microsoft, and Amazon are pushing for the implementation of different aspects of AI in business. In 2017, the hype was more on Deep Learning and Machine Learning.


How to Download 125 Million US Building Footprint Data - Geo.Appsmith

#artificialintelligence

Early this year Microsoft released approximately 125 million building footprint polygon geometries in all 50 US States in GeoJSON format. This dataset containing 125,192,184 computer generated building footprints was the output of a combination of deep learning, computer vision and artificial intelligence work by Microsoft's Bing Maps Team. The team has reportedly been been applying these techniques with the goal to increase the coverage of building footprints available for OpenStreetMap. Before the release there was an estimated 30,567,953 building footprints in the US on OpenStreetMap. The Bing Maps team used Open Source CNTK Unified Toolkit which was developed by Microsoft and applied Deep Neural Networks and the ResNet34 with RefineNet up-sampling layers to detect building footprints from the Bing imagery.


Data Science, Deep Learning, & Machine Learning with Python

#artificialintelligence

Go hands-on with the neural network, artificial intelligence, and machine learning techniques employers are seeking! Data Scientists enjoy one of the top-paying jobs, with an average salary of $120,000 according to Glassdoor and Indeed. If you've got some programming or scripting experience, this course will teach you the techniques used by real data scientists and machine learning practitioners in the tech industry - and prepare you for a move into this hot career path. This comprehensive course includes over 80** lectures** spanning 12** hours of video**, and most topics include hands-on Python code examples you can use for reference and for practice. I'll draw on my 9 years of experience at Amazon and IMDb to guide you through what matters, and what doesn't.



Interpretable Time Series Classification using All-Subsequence Learning and Symbolic Representations in Time and Frequency Domains

arXiv.org Machine Learning

The time series classification literature has expanded rapidly over the last decade, with many new classification approaches published each year. The research focus has mostly been on improving the accuracy and efficiency of classifiers, while their interpretability has been somewhat neglected. Classifier interpretability has become a critical constraint for many application domains and the introduction of the 'right to explanation' GDPR EU legislation in May 2018 is likely to further emphasize the importance of explainable learning algorithms. In this work we analyse the state-of-the-art for time series classification, and propose new algorithms that aim to maintain the classifier accuracy and efficiency, but keep interpretability as a key design constraint. We present new time series classification algorithms that advance the state-of-the-art by implementing the following three key ideas: (1) Multiple resolutions of symbolic approximations: we combine symbolic representations obtained using different parameters; (2) Multiple domain representations: we combine symbolic approximations in time (e.g., SAX) and frequency (e.g., SFA) domains; (3) Efficient navigation of a huge symbolic-words space: we adapt a symbolic sequence classifier named SEQL, to make it work with multiple domain representations (e.g., SAX-SEQL, SFA-SEQL), and use its greedy feature selection strategy to effectively filter the best features for each representation. We show that a multi-resolution multi-domain linear classifier, SAX-SFA-SEQL, achieves a similar accuracy to the state-of-the-art COTE ensemble, and to a recent deep learning method (FCN), but uses a fraction of the time required by either COTE or FCN. We discuss the accuracy, efficiency and interpretability of our proposed algorithms. To further analyse the interpretability aspect of our classifiers, we present a case study on an ecology benchmark.


Interpreting Recurrent and Attention-Based Neural Models: a Case Study on Natural Language Inference

arXiv.org Artificial Intelligence

Deep learning models have achieved remarkable success in natural language inference (NLI) tasks. While these models are widely explored, they are hard to interpret and it is often unclear how and why they actually work. In this paper, we take a step toward explaining such deep learning based models through a case study on a popular neural model for NLI. In particular, we propose to interpret the intermediate layers of NLI models by visualizing the saliency of attention and LSTM gating signals. We present several examples for which our methods are able to reveal interesting insights and identify the critical information contributing to the model decisions.


Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning

arXiv.org Machine Learning

Modern machine learning algorithms have been adopted in a range of signal-processing applications spanning computer vision, natural language processing, and artificial intelligence. Many relevant problems involve subspace-structured features, orthogonality constrained or low-rank constrained objective functions, or subspace distances. These mathematical characteristics are expressed naturally using the Grassmann manifold. Unfortunately, this fact is not yet explored in many traditional learning algorithms. In the last few years, there have been growing interests in studying Grassmann manifold to tackle new learning problems. Such attempts have been reassured by substantial performance improvements in both classic learning and learning using deep neural networks. We term the former as shallow and the latter deep Grassmannian learning. The aim of this paper is to introduce the emerging area of Grassmannian learning by surveying common mathematical problems and primary solution approaches, and overviewing various applications. We hope to inspire practitioners in different fields to adopt the powerful tool of Grassmannian learning in their research.


Multimodal Language Analysis with Recurrent Multistage Fusion

arXiv.org Machine Learning

Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the interactions between modalities (cross-modal interactions). In this paper, we propose the Recurrent Multistage Fusion Network (RMFN) which decomposes the fusion problem into multiple stages, each of them focused on a subset of multimodal signals for specialized, effective fusion. Cross-modal interactions are modeled using this multistage fusion approach which builds upon intermediate representations of previous stages. Temporal and intra-modal interactions are modeled by integrating our proposed fusion approach with a system of recurrent neural networks. The RMFN displays state-of-the-art performance in modeling human multimodal language across three public datasets relating to multimodal sentiment analysis, emotion recognition, and speaker traits recognition. We provide visualizations to show that each stage of fusion focuses on a different subset of multimodal signals, learning increasingly discriminative multimodal representations.


Large-Scale Learnable Graph Convolutional Networks

arXiv.org Machine Learning

Convolutional neural networks (CNNs) have achieved great success on grid-like data such as images, but face tremendous challenges in learning from more generic data such as graphs. In CNNs, the trainable local filters enable the automatic extraction of high-level features. The computation with filters requires a fixed number of ordered units in the receptive fields. However, the number of neighboring units is neither fixed nor are they ordered in generic graphs, thereby hindering the applications of convolutional operations. Here, we address these challenges by proposing the learnable graph convolutional layer (LGCL). LGCL automatically selects a fixed number of neighboring nodes for each feature based on value ranking in order to transform graph data into grid-like structures in 1-D format, thereby enabling the use of regular convolutional operations on generic graphs. To enable model training on large-scale graphs, we propose a sub-graph training method to reduce the excessive memory and computational resource requirements suffered by prior methods on graph convolutions. Our experimental results on node classification tasks in both transductive and inductive learning settings demonstrate that our methods can achieve consistently better performance on the Cora, Citeseer, Pubmed citation network, and protein-protein interaction network datasets. Our results also indicate that the proposed methods using sub-graph training strategy are more efficient as compared to prior approaches.