Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models
Xie, Zhifei, Lin, Mingbao, Liu, Zihang, Wu, Pengcheng, Yan, Shuicheng, Miao, Chunyan
–arXiv.org Artificial Intelligence
Recent advancements in multimodal reasoning have largely overlooked the audio modality. We introduce Audio-Reasoner, a large-scale audio language model for deep reasoning in audio tasks. We meticulously curated a large-scale and diverse multi-task audio dataset with simple annotations. Then, we leverage closed-source models to conduct secondary labeling, QA generation, along with structured COT process. These datasets together form a high-quality reasoning dataset with 1.2 million reasoning-rich samples, which we name CoTA. Following inference scaling principles, we train Audio-Reasoner on CoTA, enabling it to achieve great logical capabilities in audio reasoning. Experiments show state-of-the-art performance across key benchmarks, including MMAU-mini (+25.42%), AIR-Bench chat/foundation(+14.57%/+10.13%), and MELD (+8.01%). Our findings stress the core of structured CoT training in advancing audio reasoning.
arXiv.org Artificial Intelligence
Mar-4-2025
- Country:
- South America > Chile
- Europe > Italy
- Calabria > Catanzaro Province > Catanzaro (0.04)
- Asia
- Genre:
- Research Report > New Finding (0.66)
- Industry:
- Media > Music (0.93)
- Leisure & Entertainment (0.93)
- Technology:
- Information Technology > Artificial Intelligence
- Speech > Speech Recognition (1.00)
- Representation & Reasoning (1.00)
- Cognitive Science > Problem Solving (0.83)
- Natural Language
- Large Language Model (1.00)
- Chatbot (0.70)
- Machine Learning > Neural Networks
- Deep Learning (1.00)
- Information Technology > Artificial Intelligence