Source-free Domain Adaptation Requires Penalized Diversity