Leveraging Large Language Models for Learning Complex Legal Concepts through Storytelling
Jiang, Hang, Zhang, Xiajie, Mahari, Robert, Kessler, Daniel, Ma, Eric, August, Tal, Li, Irene, Pentland, Alex 'Sandy', Kim, Yoon, Roy, Deb, Kabbara, Jad
–arXiv.org Artificial Intelligence
Making legal knowledge accessible to non-experts is crucial for enhancing general legal literacy and encouraging civic participation in democracy. However, legal documents are often challenging to understand for people without legal backgrounds. In this paper, we present a novel application of large language models (LLMs) in legal education to help non-experts learn intricate legal concepts through storytelling, an effective pedagogical tool in conveying complex and abstract concepts. We also introduce a new dataset LegalStories, which consists of 294 complex legal doctrines, each accompanied by a story and a set of multiple-choice questions generated by LLMs. To construct the dataset, we experiment with various LLMs to generate legal stories explaining these concepts. Furthermore, we use an expert-in-the-loop approach to iteratively design multiple-choice questions. Then, we evaluate the effectiveness of storytelling with LLMs through randomized controlled trials (RCTs) with legal novices on 10 samples from the dataset. We find that LLM-generated stories enhance comprehension of legal concepts and interest in law among non-native speakers compared to only definitions. Moreover, stories consistently help participants relate legal concepts to their lives. Finally, we find that learning with stories shows a higher retention rate for non-native speakers in the follow-up assessment. Our work has strong implications for using LLMs in promoting teaching and learning in the legal field and beyond.
arXiv.org Artificial Intelligence
Jul-2-2024
- Country:
- Asia
- China
- Hong Kong (0.04)
- Jiangsu Province > Yancheng (0.04)
- Liaoning Province > Dalian (0.04)
- Japan > Honshū
- Kantō > Tokyo Metropolis Prefecture > Tokyo (0.04)
- Middle East > UAE
- Abu Dhabi Emirate > Abu Dhabi (0.14)
- Singapore (0.04)
- China
- Europe
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Czechia > Prague (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Italy > Calabria
- Catanzaro Province > Catanzaro (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Belgium > Brussels-Capital Region
- North America
- Canada
- Alberta
- Census Division No. 11 > Sturgeon County (0.24)
- Census Division No. 13 > Westlock County (0.24)
- British Columbia > Metro Vancouver Regional District
- Vancouver (0.04)
- Ontario > Toronto (0.04)
- Alberta
- Dominican Republic (0.04)
- United States
- Hawaii > Honolulu County
- Honolulu (0.04)
- Massachusetts (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- New York > Erie County
- Buffalo (0.04)
- Virginia (0.04)
- Washington > King County
- Seattle (0.14)
- Hawaii > Honolulu County
- Canada
- Asia
- Genre:
- Research Report > Experimental Study (1.00)
- Industry:
- Education > Curriculum
- Subject-Specific Education (1.00)
- Law (1.00)
- Education > Curriculum
- Technology: