Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AI
Sargeant, Holli, Jorgensen, Mackenzie, Shah, Arina, Weller, Adrian, Bhatt, Umang
–arXiv.org Artificial Intelligence
Uncertainty in artificial intelligence (AI) predictions poses urgent legal and ethical challenges for AI-assisted decision-making. We examine two algorithmic interventions that act as guardrails for human-AI collaboration: selective abstention, which withholds high-uncertainty predictions from human decision-makers, and selective friction, which delivers those predictions together with salient warnings or disclosures that slow the decision process. Research has shown that selective abstention based on uncertainty can inadvertently exacerbate disparities and disadvantage under-represented groups that disproportionately receive uncertain predictions. In this paper, we provide the first integrated socio-technical and legal analysis of uncertainty-based algorithmic interventions. Through two case studies, AI-assisted consumer credit decisions and AI-assisted content moderation, we demonstrate how the seemingly neutral use of uncertainty thresholds can trigger discriminatory impacts. We argue that, although both interventions pose risks of unlawful discrimination under UK law, selective frictions offer a promising pathway toward fairer and more accountable AI-assisted decision-making by preserving transparency and encouraging more cautious human judgment.
arXiv.org Artificial Intelligence
Aug-12-2025
- Country:
- Asia > Malaysia (0.04)
- Europe
- Austria (0.04)
- Netherlands > South Holland
- Dordrecht (0.04)
- Spain (0.04)
- Sweden > Stockholm
- Stockholm (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.14)
- Greater London > London (0.04)
- Oxfordshire > Oxford (0.04)
- North America
- Canada > Nova Scotia
- Halifax Regional Municipality > Halifax (0.04)
- Mexico > Mexico City
- Mexico City (0.04)
- United States
- Illinois > Cook County
- Chicago (0.04)
- Massachusetts > Middlesex County
- Cambridge (0.04)
- Virginia (0.04)
- Illinois > Cook County
- Canada > Nova Scotia
- Genre:
- Research Report > Experimental Study (0.46)
- Industry:
- Banking & Finance > Credit (1.00)
- Government > Regional Government
- Health & Medicine (1.00)
- Information Technology > Security & Privacy (1.00)
- Law (1.00)
- Technology:
- Information Technology
- Artificial Intelligence
- Issues > Social & Ethical Issues (1.00)
- Machine Learning (1.00)
- Natural Language (1.00)
- Representation & Reasoning (1.00)
- Communications > Social Media (1.00)
- Artificial Intelligence
- Information Technology