Efficient Conformal Prediction under Data Heterogeneity