Improve Language Model and Brain Alignment via Associative Memory