Author Unknown: Evaluating Performance of Author Extraction Libraries on Global Online News Articles
Hatwar, Sriharsha, Partridge, Virginia, Bhargava, Rahul, Bermejo, Fernando
–arXiv.org Artificial Intelligence
Analysis of large corpora of online news content requires robust validation of underlying metadata extraction methodologies. Identifying the author of a given web-based news article is one example that enables various types of research questions. While numerous solutions for off-the-shelf author extraction exist, there is little work comparing performance (especially in multilingual settings). In this paper we present a manually coded cross-lingual dataset of authors of online news articles and use it to evaluate the performance of five existing software packages and one customized model. Our evaluation shows evidence for Go-readability and Trafilatura as the most consistent solutions for author extraction, but we find all packages produce highly variable results across languages. These findings are relevant for researchers wishing to utilize author data in their analysis pipelines, primarily indicating that further validation for specific languages and geographies is required to rely on results.
arXiv.org Artificial Intelligence
Oct-13-2024
- Country:
- South America > Brazil (0.04)
- North America
- Cuba (0.04)
- United States
- Hawaii (0.04)
- California > Napa County (0.04)
- Virginia > Arlington County
- Arlington (0.04)
- New York > New York County
- New York City (0.04)
- Massachusetts > Hampshire County
- Amherst (0.04)
- Mexico > Quintana Roo
- Cancún (0.04)
- Europe
- United Kingdom > England
- Hampshire > Southampton (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- Russia > Central Federal District
- Moscow Oblast > Moscow (0.04)
- France > Provence-Alpes-Côte d'Azur
- Bouches-du-Rhône > Marseille (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- United Kingdom > England
- Asia
- Genre:
- Research Report > New Finding (0.87)
- Technology:
- Information Technology
- Software (1.00)
- Information Management (1.00)
- Data Science (1.00)
- Communications > Social Media (1.00)
- Artificial Intelligence
- Natural Language > Text Processing (1.00)
- Machine Learning > Neural Networks (0.93)
- Information Technology