Generalisation of structural knowledge in the hippocampal-entorhinal system
Whittington, James, Muller, Timothy, Mark, Shirely, Barry, Caswell, Behrens, Tim
–Neural Information Processing Systems
A central problem to understanding intelligence is the concept of generalisation. This allows previously learnt structure to be exploited to solve tasks in novel situations differing in their particularities. We take inspiration from neuroscience, specifically the hippocampal-entorhinal system known to be important for generalisation. We propose that to generalise structural knowledge, the representations of the structure of the world, i.e. how entities in the world relate to each other, need to be separated from representations of the entities themselves. We show, under these principles, artificial neural networks embedded with hierarchy and fast Hebbian memory, can learn the statistics of memories and generalise structural knowledge.
Neural Information Processing Systems
Feb-14-2020, 20:13:59 GMT
- Technology: