LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard

Rao, Varun, Sun, Youran, Kumar, Mahendra, Mutneja, Tejas, Mukherjee, Agastya, Yang, Haizhao

arXiv.org Artificial Intelligence 

--This paper investigates the application of large language models (LLMs) to financial tasks. Building on Qwen2.5 and Deepseek-R1, we employed techniques including supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) to enhance their financial capabilities. The fine-tuned models demonstrated substantial performance gains across a wide range of financial tasks. Moreover, we measured the data scaling law in the financial domain. Our work demonstrates the potential of large language models (LLMs) in financial applications.