AI models are using material from retracted scientific papers

Some companies are working to remedy the issue. Some AI chatbots rely on flawed research from retracted scientific papers to answer questions, according to recent studies. The findings, confirmed by, raise questions about how reliable AI tools are at evaluating scientific research and could complicate efforts by countries and industries seeking to invest in AI tools for scientists. AI search tools and chatbots are already known to fabricate links and references. But answers based on the material from actual papers can mislead as well if those papers have been retracted. The chatbot is "using a real paper, real material, to tell you something," says Weikuan Gu, a medical researcher at the University of Tennessee in Memphis and an author of one of the recent studies .