Neural Network Architecture for Crossmodal Activation and Perceptual Sequences

A self-organizing neural network is described that can associate between different modalities and also has the ability to learn perceptual sequences. This architecture is a step towards the development of a complete agent containing simplified versions of all major neural subsystems in a mammal. It aims at exploring as well as takes inspiration from the idea that cognitive function involves an internal simulation of perception and movement. We have tested the architecture in simulations as well as together with real sensors with very encouraging results.