While large language models (LLMs) have been explored in the speech domain for both generation and recognition tasks, their applications are predominantly confined to the monolingual scenario, with limited exploration in multilingual and code-switched (CS) contexts. Additionally, speech generation and recognition tasks are often handled separately, such as VALL-E and Qwen-Audio. In this paper, we propose a MutltiLingual MultiTask (MLMT) model, integrating multilingual speech generation and recognition tasks within the single LLM. Furthermore, we develop an effective data construction approach that splits and concatenates words from different languages to equip LLMs with CS synthesis ability without relying on CS data. The experimental results demonstrate that our model outperforms other baselines with a comparable data scale. Furthermore, our data construction approach not only equips LLMs with CS speech synthesis capability with comparable speaker consistency and similarity to any given speaker, but also improves the performance of LLMs in multilingual speech generation and recognition tasks.

Existing meta-learning based few-shot learning (FSL) methods typically adopt an episodic training strategy whereby each episode contains a meta-task. Across episodes, these tasks are sampled randomly and their relationships are ignored. In this paper, we argue that the inter-meta-task relationships should be exploited to learn models that are more generalizable to unseen classes with few-shots. Specifically, we consider the relationships between two types of meta-tasks and propose different strategies to exploit them. (1) Two meta-tasks with disjoint sets of classes: these are interesting because their relationship is reminiscent of that between the source seen classes and target unseen classes, featured with domain gap caused by class differences. A novel meta-training strategy named meta-domain adaptation (MDA) is proposed to make the meta-learned model more robust to the domain gap. (2) Two meta-tasks with identical sets of classes: these are interesting because they can be used to learn models that are robust against poorly sampled few-shots. To that end, a novel meta-knowledge distillation (MKD) strategy is formulated. Extensive experiments demonstrate that both MDA and MKD significantly boost the performance of a variety of existing FSL methods and thus achieve new state-of-the-art on three benchmarks.