white lie
TactfulToM: Do LLMs Have the Theory of Mind Ability to Understand White Lies?
Liu, Yiwei, Pretty, Emma Jane, Huang, Jiahao, Sugawara, Saku
While recent studies explore Large Language Models' (LLMs) performance on Theory of Mind (ToM) reasoning tasks, research on ToM abilities that require more nuanced social context is limited, such as white lies. We introduce TactfulToM, a novel English benchmark designed to evaluate LLMs' ability to understand white lies within real-life conversations and reason about prosocial motivations behind them, particularly when they are used to spare others' feelings and maintain social harmony. Our benchmark is generated through a multi-stage human-in-the-loop pipeline where LLMs expand manually designed seed stories into conversations to maintain the information asymmetry between participants necessary for authentic white lies. We show that TactfulToM is challenging for state-of-the-art models, which perform substantially below humans, revealing shortcomings in their ability to fully comprehend the ToM reasoning that enables true understanding of white lies.
- North America > Canada > Ontario > Toronto (0.04)
- Asia > Thailand > Bangkok > Bangkok (0.04)
- North America > United States > Florida > Miami-Dade County > Miami (0.04)
- (7 more...)
- Health & Medicine > Therapeutic Area > Neurology (0.67)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (0.67)
- Consumer Products & Services (0.67)
Improving Interpersonal Communication by Simulating Audiences with Language Models
Liu, Ryan, Yen, Howard, Marjieh, Raja, Griffiths, Thomas L., Krishna, Ranjay
How do we communicate with others to achieve our goals? We use our prior experience or advice from others, or construct a candidate utterance by predicting how it will be received. However, our experiences are limited and biased, and reasoning about potential outcomes can be difficult and cognitively challenging. In this paper, we explore how we can leverage Large Language Model (LLM) simulations to help us communicate better. We propose the Explore-Generate-Simulate (EGS) framework, which takes as input any scenario where an individual is communicating to an audience with a goal they want to achieve. EGS (1) explores the solution space by producing a diverse set of advice relevant to the scenario, (2) generates communication candidates conditioned on subsets of the advice, and (3) simulates the reactions from various audiences to determine both the best candidate and advice to use. We evaluate the framework on eight scenarios spanning the ten fundamental processes of interpersonal communication. For each scenario, we collect a dataset of human evaluations across candidates and baselines, and showcase that our framework's chosen candidate is preferred over popular generation mechanisms including Chain-of-Thought. We also find that audience simulations achieve reasonably high agreement with human raters across 5 of the 8 scenarios. Finally, we demonstrate the generality of our framework by applying it to real-world scenarios described by users on web forums. Through evaluations and demonstrations, we show that EGS enhances the effectiveness and outcomes of goal-oriented communication across a variety of situations, thus opening up new possibilities for the application of large language models in revolutionizing communication and decision-making processes.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Europe > Russia (0.04)
- Europe > Norway (0.04)
- (2 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Transportation > Air (0.70)
- Leisure & Entertainment (0.67)
- Information Technology > Security & Privacy (0.67)
- Media > News (0.47)
The use of deception in dementia-care robots: Should robots tell "white lies" to limit emotional distress?
Cox, Samuel Rhys, Cheong, Grace, Ooi, Wei Tsang
In addition, while it is dementia, there is need for professional caregivers. Assistive robots in the interests of the care-giver to ensure that the cared-for is given have been proposed as a solution to this, as they can assist people sufficient care (such as ensuring hygiene is maintained, and that both physically and socially. However, caregivers often need to use cared-for are safe) delusions from cognitive decline may conflict acts of deception (such as misdirection or white lies) in order to with these needs and cause distress. These equally would lead to ensure necessary care is provided while limiting negative impacts care-givers potentially using techniques that are in some way acts on the cared-for such as emotional distress or loss of dignity.
- Europe > Norway (0.14)
- Asia > Singapore (0.05)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- (2 more...)