Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering