DART: An AIGT Detector using AMR of Rephrased Text
Park, Hyeonchu, Kim, Byungjun, Kim, Bugeun
–arXiv.org Artificial Intelligence
As large language models (LLMs) generate more human-like texts, concerns about the side effects of AI-generated texts (AIGT) have grown. So, researchers have developed methods for detecting AIGT. However, two challenges remain. First, the performance on detecting black-box LLMs is low, because existing models have focused on syntactic features. Second, most AIGT detectors have been tested on a single-candidate setting, which assumes that we know the origin of an AIGT and may deviate from the real-world scenario. To resolve these challenges, we propose DART, which consists of four steps: rephrasing, semantic parsing, scoring, and multiclass classification. We conducted several experiments to test the performance of DART by following previous work. The experimental result shows that DART can discriminate multiple black-box LLMs without using syntactic features and knowing the origin of AIGT.
arXiv.org Artificial Intelligence
Dec-16-2024
- Country:
- Genre:
- Research Report > New Finding (0.88)
- Industry:
- Transportation (0.56)
- Technology: