AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed Bandit