LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
Rao, Varun, Sun, Youran, Kumar, Mahendra, Mutneja, Tejas, Mukherjee, Agastya, Yang, Haizhao
–arXiv.org Artificial Intelligence
--This paper investigates the application of large language models (LLMs) to financial tasks. Building on Qwen2.5 and Deepseek-R1, we employed techniques including supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) to enhance their financial capabilities. The fine-tuned models demonstrated substantial performance gains across a wide range of financial tasks. Moreover, we measured the data scaling law in the financial domain. Our work demonstrates the potential of large language models (LLMs) in financial applications.
arXiv.org Artificial Intelligence
Apr-18-2025
- Country:
- Asia
- Middle East > UAE
- Abu Dhabi Emirate > Abu Dhabi (0.14)
- Thailand > Bangkok
- Bangkok (0.04)
- Middle East > UAE
- North America > United States
- Maryland > Prince George's County > College Park (0.17)
- Asia
- Genre:
- Research Report (1.00)
- Industry:
- Banking & Finance > Trading (0.69)
- Technology: