Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversation