Deepmind Introduces PonderNet, A New AI Algorithm That Allows Artificial Neural Networks To Learn To "Think For A While" Before Answering

Deepmind introduces PonderNet, a new algorithm that allows artificial neural networks to learn to think for a while before answering. This improves the ability of these neural networks to generalize outside of their training distribution and answer tough questions with more confidence than ever before. The time required to solve a problem is not just influenced by the size of inputs but also the complexity. Also, the amount of computation used in standard neural networks is not proportional to the complexity, but rather it's proportional with size. To address this issue, Deepmind, in its latest research, presents PonderNet, which builds on Adaptive Computation Time (ACT; Graves, 2016) and other adaptive networks.