Neural Diversity Regularizes Hallucinations in Language Models