Evaluating Emotion Recognition in Spoken Language Models on Emotionally Incongruent Speech