End-to-End Deep Learning for Predicting Metric Space-Valued Outputs