Task Diversity Shortens the ICL Plateau