Do Retrieval-Augmented Language Models Adapt to Varying User Needs?