Robust Contrastive Learning Using Negative Samples with Diminished Semantics