Counterfactual Inference of Second Opinions