The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning

Neural Information Processing Systems 

Theoretically, we characterized the substitution effect and acceleration effect of the trainable, but identity-initialized prediction head.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found