Representing Part-Whole Relationships in Recurrent Neural Networks
Jain, Viren, Zhigulin, Valentin, Seung, H. S.
–Neural Information Processing Systems
There is little consensus about the computational function of top-down synaptic connections in the visual system. Here we explore the hypothesis that top-down connections, like bottom-up connections, reflect partwhole relationships. We analyze a recurrent network with bidirectional synaptic interactions between a layer of neurons representing parts and a layer of neurons representing wholes. Within each layer, there is lateral inhibition. When the network detects a whole, it can rigorously enforce part-whole relationships by ignoring parts that do not belong.
Neural Information Processing Systems
Dec-31-2006