Understanding the Effect of Stochasticity in Policy Optimization