Structured Entity Extraction Using Large Language Models
Wu, Haolun, Yuan, Ye, Mikaelyan, Liana, Meulemans, Alexander, Liu, Xue, Hensman, James, Mitra, Bhaskar
–arXiv.org Artificial Intelligence
Recent advances in machine learning have significantly impacted the field of information extraction, with Large Language Models (LLMs) playing a pivotal role in extracting structured information from unstructured text. This paper explores the challenges and limitations of current methodologies in structured entity extraction and introduces a novel approach to address these issues. We contribute to the field by first introducing and formalizing the task of Structured Entity Extraction (SEE), followed by proposing Approximate Entity Set OverlaP (AESOP) Metric designed to appropriately assess model performance on this task. Later, we propose a new model that harnesses the power of LLMs for enhanced effectiveness and efficiency through decomposing the entire extraction task into multiple stages. Quantitative evaluation and human side-by-side evaluation confirm that our model outperforms baselines, offering promising directions for future advancements in structured entity extraction.
arXiv.org Artificial Intelligence
Feb-6-2024
- Country:
- South America
- Paraguay > Asunción
- Asunción (0.04)
- Colombia > Meta Department
- Villavicencio (0.04)
- Paraguay > Asunción
- North America
- Dominican Republic (0.04)
- United States
- Arkansas (0.04)
- Missouri (0.04)
- Maine (0.04)
- New York > Monroe County
- Rochester (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- California > San Francisco County
- San Francisco (0.14)
- Canada > Quebec
- Montreal (0.04)
- Europe
- Switzerland > Zürich
- Zürich (0.04)
- Russia > Central Federal District
- Moscow Oblast > Moscow (0.04)
- Italy > Tuscany
- Florence (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Switzerland > Zürich
- Asia
- Russia (0.28)
- China > Hong Kong (0.04)
- Japan > Kyūshū & Okinawa
- Kyūshū > Miyazaki Prefecture > Miyazaki (0.04)
- South America
- Genre:
- Overview (1.00)
- Research Report > Promising Solution (0.34)
- Industry:
- Technology: