How Paralingual are Paralinguistic Representations? A Case Study in Speech Emotion Recognition