Revisiting Sparse Rewards for Goal-Reaching Reinforcement Learning