Understanding and Mitigating Distribution Shifts For Machine Learning Force Fields