Human-in-the-Loop through Chain-of-Thought