Understanding the Generalization Benefit of Model Invariance from a Data Perspective

However, a principled understanding of why invariance benefits generalization is limited. Given a dataset, there is often no principled way to select "suitable" data transformations under which model invariance guarantees better generalization.