Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
Tang, Jingyu, Chen, Chaoran, Li, Jiawen, Zhang, Zhiping, Guo, Bingcan, Khalilov, Ibrahim, Gebreegziabher, Simret Araya, Yao, Bingsheng, Wang, Dakuo, Ye, Yanfang, Li, Tianshi, Xiao, Ziang, Yao, Yaxing, Li, Toby Jia-Jun
–arXiv.org Artificial Intelligence
The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is increasingly important. We present a two-phase empirical study examining how agents, human participants, and human-AI teams respond to 16 types of dark patterns across diverse scenarios. Phase 1 highlights that agents often fail to recognize dark patterns, and even when aware, prioritize task completion over protective action. Phase 2 revealed divergent failure modes: humans succumb due to cognitive shortcuts and habitual compliance, while agents falter from procedural blind spots. Human oversight improved avoidance but introduced costs such as attentional tunneling and cognitive load. Our findings show neither humans nor agents are uniformly resilient, and collaboration introduces new vulnerabilities, suggesting design needs for transparency, adjustable autonomy, and oversight.
arXiv.org Artificial Intelligence
Sep-16-2025
- Country:
- Asia
- Indonesia > Bali (0.04)
- Japan > Honshū
- Kantō > Kanagawa Prefecture > Yokohama (0.04)
- Middle East > Palestine
- Gaza Strip > Rafah Governorate > Rafah (0.04)
- Singapore (0.04)
- Europe
- Austria > Vienna (0.14)
- Germany > Lower Saxony
- Oldenburg (0.04)
- United Kingdom
- England > Oxfordshire
- Oxford (0.04)
- Scotland > City of Glasgow
- Glasgow (0.04)
- England > Oxfordshire
- North America
- Canada > Quebec
- Montreal (0.04)
- United States
- Pennsylvania > Allegheny County
- Pittsburgh (0.14)
- New York > New York County
- New York City (0.06)
- New Jersey > Hudson County
- Hoboken (0.04)
- Georgia > Fulton County
- Atlanta (0.04)
- Illinois > Sangamon County
- Springfield (0.04)
- Michigan (0.04)
- California > Santa Clara County
- Palo Alto (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Hawaii > Honolulu County
- Honolulu (0.04)
- Pennsylvania > Allegheny County
- Canada > Quebec
- Asia
- Genre:
- Research Report
- Experimental Study (0.92)
- New Finding (1.00)
- Research Report
- Industry:
- Government (0.67)
- Health & Medicine (0.94)
- Information Technology > Security & Privacy (1.00)
- Law (0.92)
- Technology: