Lessons From an App Update at Replika AI: Identity Discontinuity in Human-AI Relationships
De Freitas, Julian, Castelo, Noah, Uguralp, Ahmet, Uguralp, Zeliha
–arXiv.org Artificial Intelligence
We leverage a natural app-update event at Replika AI, a popular US-based AI companion, to shed light on these questions. We find that, after the app removed its erotic role play (ERP) feature, preventing intimate interactions between consumers and chatbots that were previously possible, this event triggered perceptions in customers that their AI companion's identity had discontinued. This in turn predicted negative consumer welfare and marketing outcomes related to loss, including mourning the loss, and devaluing the'new' AI relative to the'original'. Experimental evidence confirms these findings. Further experiments find that AI companions users feel closer to their AI companion than even their best human friend, and mourn a loss of their AI companion more than a loss of various other inanimate products. In short, consumers are forming human-level relationships with AI companions; disruptions to these relationships trigger real patterns of mourning as well as devaluation of the offering; and the degree of mourning and devaluation are explained by perceived discontinuity in the AIs identity. Our results illustrate that relationships with AI are truly personal, creating unique benefits and risks for consumers and firms alike. The development of large language models (LLMs) and generative artificial intelligence (AI) has not only led to many new business applications (e.g., search, education software), but also enabled a new class of chatbots that has the potential to be used for building'synthetic' social relationships, which we refer to as AI companions. An increasing number of consumers use this technology to satisfy social goals (Broadbent et al. 2023; Chaturvedi et al. 2023; De Freitas et al. 2023).
arXiv.org Artificial Intelligence
Dec-10-2024
- Country:
- Asia > Middle East
- Jordan (0.04)
- Europe > United Kingdom
- Scotland > City of Edinburgh > Edinburgh (0.04)
- North America
- Canada > Alberta (0.14)
- United States (0.46)
- Asia > Middle East
- Genre:
- Questionnaire & Opinion Survey (1.00)
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Industry:
- Health & Medicine
- Consumer Health (0.67)
- Therapeutic Area > Psychiatry/Psychology
- Mental Health (0.67)
- Media (1.00)
- Health & Medicine
- Technology: