SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases