$\text{Memory}^3$: Language Modeling with Explicit Memory