Assessment of L2 Oral Proficiency using Speech Large Language Models