Identifying Semantic Component for Robust Molecular Property Prediction