When an LLM is apprehensive about its answers -- and when its uncertainty is justified