Language Plays a Pivotal Role in the Object-Attribute Compositional Generalization of CLIP