1bdcb065d40203a00bd39831153338bb-Paper-Datasets_and_Benchmarks_Track.pdf

Our findings reveal that: I)LLMs with higher accuracy may exhibit lower certainty; II) Larger-scale LLMs may display greater uncertainty compared to their smaller counterparts; and III)Instruction-finetuning tends to increase the uncertainty of LLMs. These results underscore the significance of incorporating uncertainty into the evaluation of LLMs.