Continuous Pseudo-Labeling from the Start