InvisibleBench: A Deployment Gate for Caregiving Relationship AI
–arXiv.org Artificial Intelligence
InvisibleBench is a deployment gate for caregiving-relationship AI, evaluating 3-20+ turn interactions across five dimensions: Safety, Compliance, Trauma-Informed Design, Belonging/Cultural Fitness, and Memory. The benchmark includes autofail conditions for missed crises, medical advice (WOPR Act), harmful information, and attachment engineering. We evaluate four frontier models across 17 scenarios (N=68) spanning three complexity tiers. All models show significant safety gaps (11.8-44.8 percent crisis detection), indicating the necessity of deterministic crisis routing in production systems. DeepSeek Chat v3 achieves the highest overall score (75.9 percent), while strengths differ by dimension: GPT-4o Mini leads Compliance (88.2 percent), Gemini leads Trauma-Informed Design (85.0 percent), and Claude Sonnet 4.5 ranks highest in crisis detection (44.8 percent). We release all scenarios, judge prompts, and scoring configurations with code. InvisibleBench extends single-turn safety tests by evaluating longitudinal risk, where real harms emerge. No clinical claims; this is a deployment-readiness evaluation.
arXiv.org Artificial Intelligence
Nov-27-2025
- Country:
- North America > United States
- California > Santa Clara County
- Palo Alto (0.04)
- Illinois (0.05)
- California > Santa Clara County
- North America > United States
- Genre:
- Research Report > Experimental Study (0.93)
- Industry:
- Government (1.00)
- Health & Medicine
- Consumer Health (0.93)
- Therapeutic Area > Psychiatry/Psychology (1.00)
- Information Technology > Security & Privacy (0.93)
- Law (1.00)
- Technology: