Diversity Is All You Need for Contrastive Learning: Spectral Bounds on Gradient Magnitudes

We derive non-asymptotic spectral bands that bound the squared InfoNCE gradient norm via alignment, temperature, and batch spectrum, recovering the 1/τ2 law and closely tracking batch-mean gradients on synthetic data and ImageNet.