The Capacity of the Kanerva Associative Memory is Exponential

Neural Information Processing Systems 

It is shown by sphere packing arguments that as the address length increases. This exponential grovth in capacity can actually be achieved by the Kanerva associative memory. Formulas for these op.timal values are provided. The exponential grovth in capacity for the Kanerva associative memory contrasts sharply vith the sub-linear grovth in capacity for the Hopfield associative memory. Our model of an associative memory is the folloving.