The Neural Coding Framework for Learning Generative Models

One way to understand how the brain adapts to its environment is to view it as a type of generative pattern-creation model [20], one that is engaged in a never-ending process of self-correction, often without external teaching signals (or labels) [53]. Under this perspective, the brain is continuously making predictions about elements of its environment, a process that allows it to infer useful representations of the sensory data it receives [56] as well as to synthesize novel patterns, which could serve as the potential basis for long-term planning and imagination itself [12]. From the theoretical viewpoint of predictive processing, the brain could be likened to a hierarchical model whose levels are implemented by neurons (or clusters of neurons). If levels are likened to regions of the brain, the neurons at one level (region) attempt to predict the state of neurons at another level (region) and adjust/correct their local model synaptic parameters based on how different their predictions were from the observed signal. Furthermore, these neurons utilize various mechanisms to laterally stimulate/suppress each other [40] to facilitate contextual processing (such as grouping/segmenting visual components of objects in a scene).