ReLISH: Reliable Label Inference via Smoothness Hypothesis