Goto

Collaborating Authors

 coarse-coded symbol memory


Scaling Properties of Coarse-Coded Symbol Memories

Neural Information Processing Systems

Abstract: Coarse-coded symbol memories have appeared in several neural network symbol processing models. In order to determine how these models would scale, one must first have some understanding of the mathematics of coarse-coded representa(cid:173) tions. We define the general structure of coarse-coded symbol memories and derive mathematical relationships among their essential parameters: memory 8ize, 8ymbol-8et size and capacity. The computed capacity of one of the schemes agrees well with actual measurements oC tbe coarse-coded working memory of DCPS, Touretzky and Hinton's distributed connectionist production system.


Scaling Properties of Coarse-Coded Symbol Memories

Neural Information Processing Systems

DCPS' memory scheme is a modified version of the Random Receptors method [5]. The symbol space is the set of all triples over a 25 letter alphabet. Units have fixed-size receptive fields organized as 6 x 6 x 6 subspaces. Patterns are manipulated to minimize the variance in pattern size across symbols.


Scaling Properties of Coarse-Coded Symbol Memories

Neural Information Processing Systems

DCPS' memory scheme is a modified version of the Random Receptors method [5]. The symbol space is the set of all triples over a 25 letter alphabet. Units have fixed-size receptive fields organized as 6 x 6 x 6 subspaces. Patterns are manipulated to minimize the variance in pattern size across symbols.


Scaling Properties of Coarse-Coded Symbol Memories

Neural Information Processing Systems

DCPS' memory scheme is a modified version of the Random Receptors method [5]. The symbol space is the set of all triples over a 25 letter alphabet. Units have fixed-size receptive fields organized as 6 x 6 x 6 subspaces. Patterns are manipulated to minimize the variance in pattern size across symbols.