What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis