Adaptive Data Debiasing through Bounded Exploration