Goto

Collaborating Authors

 Education







Functional Regularization for Representation Learning: A Unified Theoretical Perspective

Neural Information Processing Systems

Towards bridging this gap, we present a unifying perspective where several such approaches can be viewed as imposing a regularization on the representation via a learnable function using unlabeled data.




MPNet: Masked and Permuted Pre-training for Language Understanding

Neural Information Processing Systems

However, XLNet does not leverage the full position information of a sentence and thus suffers from position discrepancy between pre-training and fine-tuning.