Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training