Exploring the Impact of a Transformer's Latent Space Geometry on Downstream Task Performance