On the Theoretical Properties of Noise Correlation in Stochastic Optimization