AGORA: Incentivizing Group Emergence Capability in LLMs via Group Distillation
Zhuang, Ren, Wang, Ben, Sun, Shuifa
–arXiv.org Artificial Intelligence
Progress in complex reasoning is constrained by the static nature of the current training datasets. We propose structured interaction as a new scaling axis, moving beyond the prevailing paradigm of increasing model parameters. Our self-evolving framework, AGORA, enables a collaborative ensemble to achieve reasoning performance exceeding state-of-the-art monolithic systems by up to 4.45 percentage points on challenging mathematical benchmarks. This gain stems from group emergent ability--the synthesis of collective capabilities unattainable by isolated models, validating interaction as a scalable driver of intelligence.
arXiv.org Artificial Intelligence
Jul-30-2025