LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard

Rao, Varun, Sun, Youran, Kumar, Mahendra, Mutneja, Tejas, Mukherjee, Agastya, Yang, Haizhao

arXiv.org Artificial Intelligence 

--This paper investigates the application of large language models (LLMs) to financial tasks. Building on Qwen2.5 and Deepseek-R1, we employed techniques including supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) to enhance their financial capabilities. The fine-tuned models demonstrated substantial performance gains across a wide range of financial tasks. Moreover, we measured the data scaling law in the financial domain. Our work demonstrates the potential of large language models (LLMs) in financial applications.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found