Text Detoxification as Style Transfer in English and Hindi
Mukherjee, Sourabrata, Bansal, Akanksha, Ojha, Atul Kr., McCrae, John P., Dušek, Ondřej
–arXiv.org Artificial Intelligence
This paper focuses on text detoxification, i.e., automatically converting toxic text into non-toxic text. This task contributes to safer and more respectful online communication and can be considered a Text Style Transfer (TST) task, where the text style changes while its content is preserved. We present three approaches: knowledge transfer from a similar task, multi-task learning approach, combining sequence-to-sequence modeling with various toxicity classification tasks, and, delete and reconstruct approach. To support our research, we utilize a dataset provided by Dementieva et al.(2021), which contains multiple versions of detoxified texts corresponding to toxic texts. In our experiments, we selected the best variants through expert human annotators, creating a dataset where each toxic sentence is paired with a single, appropriate detoxified version. Additionally, we introduced a small Hindi parallel dataset, aligning with a part of the English dataset, suitable for evaluation purposes. Our results demonstrate that our approach effectively balances text detoxication while preserving the actual content and maintaining fluency.
arXiv.org Artificial Intelligence
Feb-12-2024
- Country:
- Oceania > Australia
- North America
- Mexico (0.04)
- Dominican Republic (0.04)
- United States
- Pennsylvania (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- California
- San Diego County > San Diego (0.04)
- Los Angeles County > Long Beach (0.04)
- Canada
- Europe
- Czechia > Prague (0.04)
- Ukraine > Kyiv Oblast
- Kyiv (0.04)
- Sweden > Stockholm
- Stockholm (0.04)
- Middle East > Malta
- Port Region > Southern Harbour District > Valletta (0.04)
- Ireland
- Leinster > County Dublin
- Dublin (0.04)
- Connaught > County Galway
- Galway (0.04)
- Leinster > County Dublin
- France > Provence-Alpes-Côte d'Azur
- Bouches-du-Rhône > Marseille (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Asia
- Genre:
- Research Report > New Finding (1.00)
- Technology: