Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings

Semantic representation learning for sentences is an important and well-studied problem in NLP . The current trend for this task involves training a Transformer-based sentence encoder through a contrastive objective with text, i.e., clustering