Investigating ReLoRA: Effects on the Learning Dynamics of Small Language Models