Noise-induced degeneration in online learning