MELO: An Evaluation Benchmark for Multilingual Entity Linking of Occupations
Retyk, Federico, Gasco, Luis, Carrino, Casimiro Pio, Deniz, Daniel, Zbib, Rabih
–arXiv.org Artificial Intelligence
We present the Multilingual Entity Linking of Occupations (MELO) Benchmark, a new collection of 48 datasets for evaluating the linking of entity mentions in 21 languages to the ESCO Occupations multilingual taxonomy. MELO was built using high-quality, pre-existent human annotations. We conduct experiments with simple lexical models and general-purpose sentence encoders, evaluated as bi-encoders in a zero-shot setup, to establish baselines for future research.
arXiv.org Artificial Intelligence
Oct-10-2024
- Country:
- Asia > China
- Hong Kong (0.04)
- Europe
- Hungary (0.04)
- Portugal (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Czechia (0.04)
- Sweden (0.04)
- Croatia (0.04)
- Romania (0.04)
- Estonia (0.04)
- Lithuania (0.04)
- Latvia (0.04)
- Italy
- Slovenia (0.04)
- Slovakia (0.04)
- Norway (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Netherlands (0.04)
- Spain (0.04)
- France > Provence-Alpes-Côte d'Azur
- Bouches-du-Rhône > Marseille (0.04)
- Germany (0.04)
- Poland (0.04)
- Middle East > Malta
- Eastern Region > Northern Harbour District > St. Julian's (0.04)
- Bulgaria (0.04)
- Austria (0.04)
- North America
- Canada > Ontario
- Toronto (0.04)
- United States
- California > Los Angeles County
- Los Angeles (0.14)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- Washington > King County
- Seattle (0.04)
- California > Los Angeles County
- Canada > Ontario
- Asia > China
- Genre:
- Research Report (1.00)
- Industry:
- Government > Regional Government (0.46)
- Technology: