Even Small Correlation and Diversity Shifts Pose Dataset-Bias Issues