Active Learning Helps Pretrained Models Learn the Intended Task Alex T amkin * Dat Nguyen

We investigate whether pretrained models are better active learners, capable of choosing examples that improve robustness to such spurious correlations and domain shifts.