Can Community Notes Replace Professional Fact-Checkers?
Borenstein, Nadav, Warren, Greta, Elliott, Desmond, Augenstein, Isabelle
–arXiv.org Artificial Intelligence
Two commonly-employed strategies to combat the rise of misinformation on social media are (i) fact-checking by professional organisations and (ii) community moderation by platform users. Policy changes by Twitter/X and, more recently, Meta, signal a shift away from partnerships with fact-checking organisations and towards an increased reliance on crowdsourced community notes. However, the extent and nature of dependencies between fact-checking and helpful community notes remain unclear. To address these questions, we use language models to annotate a large corpus of Twitter/X community notes with attributes such as topic, cited sources, and whether they refute claims tied to broader misinformation narratives. Our analysis reveals that community notes cite fact-checking sources up to five times more than previously reported. Fact-checking is especially crucial for notes on posts linked to broader narratives, which are twice as likely to reference fact-checking sources compared to other sources. In conclusion, our results show that successful community moderation heavily relies on professional fact-checking.
arXiv.org Artificial Intelligence
Feb-19-2025
- Country:
- Africa (0.04)
- Asia
- Cambodia (0.04)
- Middle East > Israel (0.04)
- Malaysia (0.04)
- Japan (0.04)
- South Korea > Seoul
- Seoul (0.04)
- Sri Lanka (0.04)
- Thailand (0.14)
- India (0.05)
- Afghanistan (0.04)
- Europe
- Denmark > Capital Region
- Copenhagen (0.04)
- Greece (0.04)
- Ireland (0.04)
- Middle East
- Cyprus (0.04)
- Malta > Eastern Region
- Northern Harbour District > St. Julian's (0.04)
- Poland (0.04)
- Ukraine (0.14)
- Denmark > Capital Region
- North America
- Canada (0.04)
- United States > California
- Yolo County > Davis (0.04)
- Oceania
- Australia (0.04)
- New Zealand (0.04)
- Genre:
- Research Report > New Finding (1.00)
- Industry:
- Government
- Health & Medicine > Therapeutic Area
- Immunology (1.00)
- Infections and Infectious Diseases (0.95)
- Information Technology > Services (0.88)
- Law (1.00)
- Media > News (1.00)
- Technology: