To Augment or Not to Augment? Diagnosing Distributional Symmetry Breaking