Minion: A Technology Probe for Resolving Value Conflicts through Expert-Driven and User-Driven Strategies in AI Companion Applications
Fan, Xianzhe, Xiao, Qing, Zhou, Xuhui, Su, Yuran, Lu, Zhicong, Sap, Maarten, Shen, Hong
–arXiv.org Artificial Intelligence
AI companions based on large language models can role-play and converse very naturally. When value conflicts arise between the AI companion and the user, it may offend or upset the user. Yet, little research has examined such conflicts. We first conducted a formative study that analyzed 151 user complaints about conflicts with AI companions, providing design implications for our study. Based on these, we created Minion, a technology probe to help users resolve human-AI value conflicts. Minion applies a user-empowerment intervention method that provides suggestions by combining expert-driven and user-driven conflict resolution strategies. We conducted a technology probe study, creating 40 value conflict scenarios on Character.AI and Talkie. 22 participants completed 274 tasks and successfully resolved conflicts 94.16% of the time. We summarize user responses, preferences, and needs in resolving value conflicts, and propose design implications to reduce conflicts and empower users to resolve them more effectively.
arXiv.org Artificial Intelligence
Nov-11-2024
- Country:
- Asia
- Europe
- Germany > Hamburg (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- North America
- Dominican Republic (0.04)
- United States
- Hawaii > Honolulu County
- Honolulu (0.04)
- Massachusetts > Suffolk County
- Boston (0.04)
- New York > New York County
- New York City (0.04)
- Pennsylvania > Allegheny County
- Pittsburgh (0.14)
- Virginia (0.04)
- Washington > King County
- Seattle (0.04)
- Hawaii > Honolulu County
- Oceania > Australia
- South America > Brazil
- Rio de Janeiro > Rio de Janeiro (0.04)
- Genre:
- Personal > Interview (1.00)
- Research Report
- Experimental Study (0.67)
- New Finding (0.67)
- Industry:
- Health & Medicine > Therapeutic Area
- Psychiatry/Psychology > Mental Health (0.67)
- Media (1.00)
- Health & Medicine > Therapeutic Area
- Technology:
- Information Technology
- Artificial Intelligence
- Cognitive Science (0.92)
- Machine Learning (1.00)
- Natural Language
- Chatbot (1.00)
- Large Language Model (0.89)
- Representation & Reasoning (1.00)
- Robots (0.93)
- Communications > Social Media (1.00)
- Artificial Intelligence
- Information Technology