Towards Unraveling and Improving Generalization in World Models