ChatGPT Writes Well Enough to Fool Scientific Reviewers

But in the remaining 32% of cases, the subjects were tricked. And that's despite just 8% of the falsified abstracts meeting the specific formatting and style requirement for the listed journal. Plus, the reviewers falsely identified 14% of the real article abstracts as having been AI-generated. "Reviewers indicated that it was surprisingly difficult to differentiate between the two," wrote the study researchers in the pre-print. While they were sorting the abstracts, the reviewers noted that they thought the generated samples were vaguer and more formulaic.