Supplementary Material A Experimentation Details

A.1 Source code Upon request, we will provide an anonymized version of our code in the rebuttal. A.2 Decision Oriented Model Learning We replicated our experiments using the codebase provided by Shah et al. [2022], which can be found at github. To ensure consistency, we used the same hyperparameters as mentioned in the code or article for the baselines. Our metric learning pipeline was added on top of their code, and thus we focused on tuning hyperparameters related to metric learning. This helps ensure the stability of metric learning. We initialize the parameters in such a way that the predicted metric is close to the Euclidean metric.