Can We Trust LLMs? Mitigate Overconfidence Bias in LLMs through Knowledge Transfer