All Roads Lead to Rome? Exploring the Invariance of Transformers' Representations