Memory Augmented Cross-encoders for Controllable Personalized Search