Word2Spike: Poisson Rate Coding for Associative Memories and Neuromorphic Algorithms
Kalra, Archit, Sadanand, Midhun
–arXiv.org Artificial Intelligence
Spiking neural networks offer a promising path toward energy-efficient, brain-like associative memory. This paper introduces Word2Spike, a novel rate coding mechanism that combines continuous word embeddings and neuromorphic architectures. We develop a one-to-one mapping that converts multi-dimensional word vectors into spike-based attractor states using Poisson processes. Using BitNet b1.58 quantization, we maintain 97% semantic similarity of continuous embed-dings on SimLex-999 while achieving 100% reconstruction accuracy on 10,000 words from OpenAI's text-embedding-3-large. We preserve analogy performance (100% of original embedding performance) even under intentionally introduced noise, indicating a resilient mechanism for semantic encoding in neuromorphic systems.
arXiv.org Artificial Intelligence
Sep-10-2025
- Country:
- North America > United States (0.29)
- Genre:
- Research Report (0.44)
- Industry:
- Health & Medicine (0.69)
- Technology: