Improving Group Robustness on Spurious Correlation Requires Preciser Group Inference