u-HuBERT: UnifiedMixed-ModalSpeechPretraining AndZero-ShotTransfertoUnlabeledModality

Byutilizingmodality dropout during pre-training, we demonstrate that a single fine-tuned model can achieve performance on par or better than the state-of-the-art modality-specific models.