Goto

Collaborating Authors

 Deep Learning


Speech Emotion Recognition Considering Local Dynamic Features

arXiv.org Artificial Intelligence

Recently, increasing attention has been directed to the study of the speech emotion recognition, in which global acoustic features of an utterance are mostly used to eliminate the content differences. However, the expression of speech emotion is a dynamic process, which is reflected through dynamic durations, energies, and some other prosodic information when one speaks. In this paper, a novel local dynamic pitch probability distribution feature, which is obtained by drawing the histogram, is proposed to improve the accuracy of speech emotion recognition. Compared with most of the previous works using global features, the proposed method takes advantage of the local dynamic information conveyed by the emotional speech. Several experiments on Berlin Database of Emotional Speech are conducted to verify the effectiveness of the proposed method. The experimental results demonstrate that the local dynamic information obtained with the proposed method is more effective for speech emotion recognition than the traditional global features.


Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation

arXiv.org Artificial Intelligence

Existing research studies on vision and language grounding for robot navigation focus on improving model-free deep reinforcement learning (DRL) models in synthetic environments. However, model-free DRL models do not consider the dynamics in the real-world environments, and they often fail to generalize to new scenes. In this paper, we take a radical approach to bridge the gap between synthetic studies and real-world practices---We propose a novel, planned-ahead hybrid reinforcement learning model that combines model-free and model-based reinforcement learning to solve a real-world vision-language navigation task. Our look-ahead module tightly integrates a look-ahead policy model with an environment model that predicts the next state and the reward. Experimental results suggest that our proposed method significantly outperforms the baselines and achieves the best on the real-world Room-to-Room dataset. Moreover, our scalable method is more generalizable when transferring to unseen environments, and the relative success rate is increased by 15.5% on the unseen test set.


Attention on Attention: Architectures for Visual Question Answering (VQA)

arXiv.org Artificial Intelligence

Visual Question Answering (VQA) is an increasingly popular topic in deep learning research, requiring coordination of natural language processing and computer vision modules into a single architecture. We build upon the model which placed first in the VQA Challenge by developing thirteen new attention mechanisms and introducing a simplified classifier. We performed 300 GPU hours of extensive hyperparameter and architecture searches and were able to achieve an evaluation score of 64.78%, outperforming the existing state-of-the-art single model's validation score of 63.15%.


IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoning

arXiv.org Artificial Intelligence

In order to reach human performance on complex visual tasks, artificial systems need to incorporate a significant amount of understanding of the world in terms of macroscopic objects, movements, forces, etc. Inspired by work on intuitive physics in infants, we propose an evaluation framework which diagnoses how much a given system understands about physics by testing whether it can tell apart well matched videos of possible versus impossible events. The test requires systems to compute a physical plausibility score over an entire video. It is free of bias and can test a range of specific physical reasoning skills. We then describe the first release of a benchmark dataset aimed at learning intuitive physics in an unsupervised way, using videos constructed with a game engine. We describe two Deep Neural Network baseline systems trained with a future frame prediction objective and tested on the possible versus impossible discrimination task. The analysis of their results compared to human data gives novel insights in the potentials and limitations of next frame prediction architectures.


From neural nets to autonomous machine learning algorithms: The many different ways marketers define AI - Digiday

#artificialintelligence

Artificial intelligence is one of the marketing industry's principal buzzwords right now. Like many en vogue terms, definitions can range all over the map. We asked eight agency executives to give a clear and concise definition of AI. Jason Goldberg, svp of commerce and content, SapientRazorfish AI are computer systems able to perform tasks that normally require human intelligence. Machine learning is a subset of AI, and deep learning is a subset of machine learning. Essentially in deep learning, instead of writing a set of programmatic rules, a model can be developed that can be trained with a data set that allows the model "to learn."


stared/livelossplot

#artificialintelligence

Don't train deep learning models blindfolded! Be impatient and look at each epoch of your training! So remember, log your loss! Text logs are easy, but it's easy to miss the most crucial information: is it learning, doing nothing or overfitting? Visual feedback allows us to keep track of the training proces. Now there is one for Jupyter.


How to set-up a powerful and cost-efficient GPU server for deep learning

@machinelearnbot

Paperspace offers multiple templates for you to start. I recommend using the fast.ai This template is intended to provide a fully functional machine learning environment for interactive development. The template includes NVIDIA's libraries for using the GPU to run Machine Learning programs, as well as a variety of libraries for ML development (Anaconda Python distribution, Jupyter notebook, fast.ai Due to high demand, your request might take a few hours to be completed.


Foolbox: A Python toolbox to benchmark the robustness of machine learning models

arXiv.org Machine Learning

Even todays most advanced machine learning models are easily fooled by almost imperceptible perturbations of their inputs. Foolbox is a new Python package to generate such adversarial perturbations and to quantify and compare the robustness of machine learning models. It is build around the idea that the most comparable robustness measure is the minimum perturbation needed to craft an adversarial example. To this end, Foolbox provides reference implementations of most published adversarial attack methods alongside some new ones, all of which perform internal hyperparameter tuning to find the minimum adversarial perturbation. Additionally, Foolbox interfaces with most popular deep learning frameworks such as PyTorch, Keras, TensorFlow, Theano and MXNet and allows different adversarial criteria such as targeted misclassification and top-k misclassification as well as different distance measures. The code is licensed under the MIT license and is openly available at https://github.com/bethgelab/foolbox . The most up-to-date documentation can be found at http://foolbox.readthedocs.io .


Linear Algebra for Deep Learning - Machine Learning Mastery

#artificialintelligence

Linear algebra is a field of applied mathematics that is a prerequisite to reading and understanding the formal description of deep learning methods, such as in papers and textbooks. Generally, an understanding of linear algebra (or parts thereof) is presented as a prerequisite for machine learning. Although important, this area of mathematics is seldom covered by computer science or software engineering degree programs. In this post, you will discover the crash course in linear algebra for deep learning presented in the de facto textbook on deep learning. Linear Algebra for Deep Learning Photo by Quinn Dombrowski, some rights reserved.


How an AI Engine can improve your business – Towards Data Science

@machinelearnbot

Crawling target blogs, forums and news sites to extract comments related to a specific product or company and then proceeding to automatically summarize and analyze related sentiment with a view to providing valuable insights in regards to products and services. Finding potential customers using the'About' section found on may web sites Given a list of target company web sites (for example from CrunchBase), a specialized crawler can extract texts from the'About' section, summarize and classify these texts, and then provide insights in order to locate those companies from the list that may be of interest as potential customers by classifying against the'About' section of current customers.