A Latent Space Metric for Enhancing Prediction Confidence in Earth Observation Data