Neural Turing Machines

Essentially an architecture with a controller (FNN, RNN, LSTM) that has read/write access to a memory in order to learn a particular task. The controller gets an input, can read/write to memory block and then output a result. When reading and writing to the memory matrix, introspective attention is used. All of this is end-to-end differentiable, so theoretically we can learn very complex tasks.