New computational algorithms make it possible to build neural networks with many input nodes and many layers, and distinguish "deep learning" of these networks from previous work on artificial neural nets.
The quest for algorithms that enable cognitive abilities is an important part of machine learning. A common trait in many recently investigated cognitive-like tasks is that they take into account different data modalities, such as visual and textual input.
Unfortunately, if cross-task knowledge transfer is impossible, then we will overfit each task due to limited amount of labeled data. One way to circumvent this dilemma is to use an external data source, e.g.
We propose a novel attention mechanism for implementing the covert attention. Here, the architecture is used for multi-label image classifica-31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.