Make Satire Boring Again: Reducing Stylistic Bias of Satirical Corpus by Utilizing Generative LLMs
Ozturk, Asli Umay, Cekinel, Recep Firat, Karagoz, Pinar
–arXiv.org Artificial Intelligence
Satire detection is essential for accurately extracting opinions from textual data and combating misinformation online. However, the lack of diverse corpora for satire leads to the problem of stylistic bias which impacts the models' detection performances. This study proposes a debiasing approach for satire detection, focusing on reducing biases in training data by utilizing generative large language models. The approach is evaluated in both cross-domain (irony detection) and cross-lingual (English) settings. Results show that the debiasing method enhances the robustness and generalizability of the models for satire and irony detection tasks in Turkish and English. However, its impact on causal language models, such as Llama-3.1, is limited. Additionally, this work curates and presents the Turkish Satirical News Dataset with detailed human annotations, with case studies on classification, debiasing, and explainability.
arXiv.org Artificial Intelligence
Dec-12-2024
- Country:
- Asia
- Afghanistan > Kabul Province
- Kabul (0.04)
- Middle East
- Republic of Türkiye
- Ankara Province > Ankara (0.04)
- Bingoel Province > Bingol (0.04)
- Yozgat Province > Yozgat (0.04)
- Syria > Aleppo Governorate
- Aleppo (0.04)
- Republic of Türkiye
- Afghanistan > Kabul Province
- Europe (0.14)
- North America > United States
- Minnesota > Hennepin County > Minneapolis (0.14)
- Asia
- Genre:
- Research Report > New Finding (1.00)
- Industry:
- Government (1.00)
- Media > News (1.00)
- Technology: