Revisiting Generalization Across Difficulty Levels: It's Not So Easy