On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding