The Knowledge-Behaviour Disconnect in LLM-based Chatbots