ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine

Large language models (LLMs) have gained significant attention over the past few years, particularly following the emergence of ChatGPT, both from researchers Movva et al. [2024] and in terms of their adoption in the private sector. This hype has revolutionized how we use AI in different fields and helped redefine how various domains utilize AI, such as in medicine Alghamdi and Mostafa [2024], Yuan et al. [2024], finance Xie et al. [2024], Malaysha et al. [2024], and even agriculture Gupta et al. [2024]. These advancements demonstrate the profound potential of AI to transform industries, driving innovation and efficiency in ways previously unimaginable. However, one domain that still has room for growth and the potential to bring about significant change is the legal domain Martin et al. [2024], Maree et al. [2024]. Although sectors such as healthcare and finance have rapidly adopted AI to address their unique challenges, the legal industry has been relatively slow to embrace these technologies Legg and Bell [2020]. The complex nature of legal language, coupled with jurisdictional variations and the high stakes involved, and the lack of AI regulations de Almeida et al. [2021], Nadjia [2024], has presented significant obstacles to developing effective AI-powered legal