More Data Can Lead Us Astray: Active Data Acquisition in the Presence of Label Bias