Mitigating Covariate Shift in Misspecified Regression with Applications to Reinforcement Learning