Banishing LLM Hallucinations Requires Rethinking Generalization