Geodesics in fibered latent spaces: A geometric approach to learning correspondences between conditions