Adaptive Bounded Exploration and Intermediate Actions for Data Debiasing