Large Language Models Are More Persuasive Than Incentivized Human Persuaders
Schoenegger, Philipp, Salvi, Francesco, Liu, Jiacheng, Nan, Xiaoli, Debnath, Ramit, Fasolo, Barbara, Leivada, Evelina, Recchia, Gabriel, Günther, Fritz, Zarifhonarvar, Ali, Kwon, Joe, Islam, Zahoor Ul, Dehnert, Marco, Lee, Daryl Y. H., Reinecke, Madeline G., Kamper, David G., Kobaş, Mert, Sandford, Adam, Kgomo, Jonas, Hewitt, Luke, Kapoor, Shreya, Oktar, Kerem, Kucuk, Eyup Engin, Feng, Bo, Jones, Cameron R., Gainsburg, Izzy, Olschewski, Sebastian, Heinzelmann, Nora, Cruz, Francisco, Tappin, Ben M., Ma, Tao, Park, Peter S., Onyonka, Rayan, Hjorth, Arthur, Slattery, Peter, Zeng, Qingcheng, Finke, Lennart, Grossmann, Igor, Salatiello, Alessandro, Karger, Ezra
–arXiv.org Artificial Intelligence
We directly compare the persuasion capabilities of a frontier large language model (LLM; Claude Sonnet 3.5) against incentivized human persuaders in an interactive, real - time conversational quiz setting. In this preregistered, large - scale incentivized expe riment, participants (quiz takers) completed an online quiz where persuaders (either humans or LLMs) attempted to persuade quiz takers toward correct or incorrect answers. We find that LLM persuaders achieved significantly higher compliance with their dire ctional persuasion attempts than incentivized human persuaders, demonstrating superior persuasive capabilities in both truthful (toward correct answers) and deceptive (toward incorrect answers) contexts. We also find that LLM persuaders significantly incre ased quiz takers' accuracy, leading to higher earnings, when steering quiz takers toward correct answers, and significantly decreased their accuracy, leading to lower earnings, when steering them toward incorrect answers. Overall, our findings suggest that AI's persuasion capabilities already exceed those of humans that have real - money bonuses tied to performance. Our findings of increasingly capable AI persuaders thus underscore the urgency of emerging alignment and governance frameworks.
arXiv.org Artificial Intelligence
May-22-2025
- Country:
- Africa > South Africa
- Gauteng > Johannesburg (0.04)
- Asia > China (0.04)
- Atlantic Ocean > North Atlantic Ocean
- English Channel (0.04)
- Europe
- Sweden > Västerbotten County
- Umeå (0.04)
- Portugal > Lisbon
- Lisbon (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Oxfordshire > Oxford (0.04)
- Switzerland
- Basel-City > Basel (0.04)
- Zürich > Zürich (0.04)
- Spain (0.04)
- Germany
- Baden-Württemberg > Tübingen Region
- Tübingen (0.04)
- Bavaria > Middle Franconia
- Nuremberg (0.04)
- Baden-Württemberg > Tübingen Region
- Middle East > Malta (0.04)
- Andorra (0.04)
- Liechtenstein (0.04)
- Sweden > Västerbotten County
- North America
- Canada (0.04)
- United States
- California
- Los Angeles County > Los Angeles (0.28)
- San Diego County > San Diego (0.04)
- Santa Clara County > Stanford (0.04)
- Washington > King County
- Seattle (0.04)
- Illinois > Cook County
- Chicago (0.04)
- New York (0.04)
- Texas (0.04)
- Arizona > Maricopa County
- Phoenix (0.04)
- Maryland > Prince George's County
- College Park (0.04)
- Indiana (0.04)
- Minnesota (0.04)
- Arkansas (0.04)
- Virginia > Richmond (0.04)
- California
- Oceania
- Australia
- Australian Capital Territory > Canberra (0.04)
- Tasmania (0.04)
- New Zealand (0.04)
- Vanuatu > Shefa
- Port-Vila (0.04)
- Australia
- South America (0.04)
- Africa > South Africa
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Research Report
- Industry:
- Banking & Finance (1.00)
- Education (0.93)
- Government
- Health & Medicine (0.93)
- Information Technology > Security & Privacy (0.67)
- Leisure & Entertainment (0.92)
- Media (1.00)
- Technology: