On the Overconfidence Problem in Semantic 3D Mapping