Cross-Lingual Interleaving for Speech Language Models