This paper presents a comprehensive overview of the first edition of the Academic Essay Authenticity Challenge, organized as part of the GenAI Content Detection shared tasks collocated with COLING 2025. This challenge focuses on detecting machine-generated vs. human-authored essays for academic purposes. The task is defined as follows: "Given an essay, identify whether it is generated by a machine or authored by a human.'' The challenge involves two languages: English and Arabic. During the evaluation phase, 25 teams submitted systems for English and 21 teams for Arabic, reflecting substantial interest in the task. Finally, seven teams submitted system description papers. The majority of submissions utilized fine-tuned transformer-based models, with one team employing Large Language Models (LLMs) such as Llama 2 and Llama 3. This paper outlines the task formulation, details the dataset construction process, and explains the evaluation framework. Additionally, we present a summary of the approaches adopted by participating teams. Nearly all submitted systems outperformed the n-gram-based baseline, with the top-performing systems achieving F1 scores exceeding 0.98 for both languages, indicating significant progress in the detection of machine-generated text.

Last December, Moby-Dick made one of my students gasp. It wasn't the first time this had happened (weird book), but nothing about the text itself produced the response. For the final project in my English class for high-school seniors, where we spend a semester reading Moby-Dick, I assigned a pretty standard eight-to-10-page research paper. One student, interested in finance, saw a connection between the plot and the 2008 financial crisis. He spent weeks thinking about the parallels, trying to find a way to make all of the pieces fit together into a cohesive argument about whaling and the exploitations of global capitalism.

The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years. The new generation AI systems such as chatbots have become more accessible on the Internet and stronger in terms of capabilities. The use of chatbots, particularly ChatGPT, for generating academic essays at schools and colleges has sparked fears among scholars. This study aims to explore the originality of contents produced by one of the most popular AI chatbots, ChatGPT. To this end, two popular plagiarism detection tools were used to evaluate the originality of 50 essays generated by ChatGPT on various topics. Our results manifest that ChatGPT has a great potential to generate sophisticated text outputs without being well caught by the plagiarism check software. In other words, ChatGPT can create content on many topics with high originality as if they were written by someone. These findings align with the recent concerns about students using chatbots for an easy shortcut to success with minimal or no effort. Moreover, ChatGPT was asked to verify if the essays were generated by itself, as an additional measure of plagiarism check, and it showed superior performance compared to the traditional plagiarism-detection tools. The paper discusses the need for institutions to consider appropriate measures to mitigate potential plagiarism issues and advise on the ongoing debate surrounding the impact of AI technology on education. Further implications are discussed in the paper.

"The 360" shows you diverse perspectives on the day's top stories and debates. Artificial intelligence has advanced at an extraordinary pace over the past few years. Today, these incredibly complex algorithms are capable of creating award-winning art, penning scripts that can be turned into real films and -- in the latest step that has dazzled people in the tech and media industries -- mimic writing at a level so convincing that it's impossible to tell whether the words were put together by a human or a machine. A few weeks ago, the research company OpenAI released ChatGPT, a language model that can construct remarkably well-structured arguments based on simple prompts provided by a user. The system -- which uses a massive repository of online text to predict what words should come next -- is able to create new stories in the style of famous writers, write news articles about itself and produce essays that could easily receive a passing grade in most English classes.