Your Model is Overconfident, and Other Lies We Tell Ourselves