Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AI
Sargeant, Holli, Jorgensen, Mackenzie, Shah, Arina, Weller, Adrian, Bhatt, Umang
–arXiv.org Artificial Intelligence
Uncertainty in artificial intelligence (AI) predictions poses urgent legal and ethical challenges for AI-assisted decision-making. We examine two algorithmic interventions that act as guardrails for human-AI collaboration: selective abstention, which withholds high-uncertainty predictions from human decision-makers, and selective friction, which delivers those predictions together with salient warnings or disclosures that slow the decision process. Research has shown that selective abstention based on uncertainty can inadvertently exacerbate disparities and disadvantage under-represented groups that disproportionately receive uncertain predictions. In this paper, we provide the first integrated socio-technical and legal analysis of uncertainty-based algorithmic interventions. Through two case studies, AI-assisted consumer credit decisions and AI-assisted content moderation, we demonstrate how the seemingly neutral use of uncertainty thresholds can trigger discriminatory impacts. We argue that, although both interventions pose risks of unlawful discrimination under UK law, selective frictions offer a promising pathway toward fairer and more accountable AI-assisted decision-making by preserving transparency and encouraging more cautious human judgment.
arXiv.org Artificial Intelligence
Aug-12-2025
- Country:
- North America > United States (1.00)
- Europe > United Kingdom
- England (0.46)
- Genre:
- Research Report > Experimental Study (0.46)
- Industry:
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Health & Medicine (1.00)
- Banking & Finance > Credit (1.00)
- Government > Regional Government
- Technology:
- Information Technology
- Communications > Social Media (1.00)
- Artificial Intelligence
- Representation & Reasoning (1.00)
- Natural Language (1.00)
- Machine Learning (1.00)
- Issues > Social & Ethical Issues (1.00)
- Information Technology