Navigating the Effect of Parametrization for Dimensionality Reduction