The Efficacy of Self-Supervised Speech Models for Audio Representations