Vector Quantization in the Brain: Grid-like Codes in World Models
Peng, Xiangyuan, Dong, Xingsi, Wu, Si
–arXiv.org Artificial Intelligence
We propose Grid-like Code Quantization (GCQ), a brain-inspired method for compressing observation-action sequences into discrete representations using grid-like patterns in attractor dynamics. Unlike conventional vector quantization approaches that operate on static inputs, GCQ performs spatiotemporal compression through an action-conditioned codebook, where codewords are derived from continuous attractor neural networks and dynamically selected based on actions. This enables GCQ to jointly compress space and time, serving as a unified world model. The resulting representation supports long-horizon prediction, goal-directed planning, and inverse modeling. Experiments across diverse tasks demonstrate GCQ's effectiveness in compact encoding and downstream performance. Our work offers both a computational tool for efficient sequence modeling and a theoretical perspective on the formation of grid-like codes in neural systems.
arXiv.org Artificial Intelligence
Oct-21-2025
- Country:
- Asia > China (0.04)
- North America > United States
- Illinois > Cook County > Chicago (0.04)
- Genre:
- Research Report > Experimental Study (1.00)
- Industry:
- Health & Medicine > Therapeutic Area > Neurology (0.94)
- Technology: