Learning with Noisy Foundation Models