Effective Controllable Bias Mitigation for Classification and Retrieval using Gate Adapters