Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization

Or is the invariance principle itself insufficient? To answer these questions, we revisit the fundamental assumptions in linear regression tasks, where invariance-based approaches were shown to provably generalize OOD.