Could a Neural Turing Machine be used to learn how to design better neural networks? • /r/MachineLearning


Can we design a system that automates the search for the optimal design? Maybe it can find surprising solutions. What would be the minimal neural net that learns a given task and also learns to improve itself (the minimal Gödel machine)? It would be as if we endowed neural nets with the power of procreation.