Transformer as a hippocampal memory consolidation model based on NMDAR-inspired nonlinearity Dong-Kyum Kim

Neural Information Processing Systems 

The hippocampus plays a critical role in learning, memory, and spatial representation, processes that depend on the NMDA receptor (NMDAR).