Natural Language Inference Improves Compositionality in Vision-Language Models