Towards User-Focused Research in Training Data Attribution for Human-Centered Explainable AI
Nguyen, Elisa, Bertram, Johannes, Kortukov, Evgenii, Song, Jean Y., Oh, Seong Joon
–arXiv.org Artificial Intelligence
While Explainable AI (XAI) aims to make AI understandable and useful to humans, it has been criticised for relying too much on formalism and solutionism, focusing more on mathematical soundness than user needs. We propose an alternative to this bottom-up approach inspired by design thinking: the XAI research community should adopt a top-down, user-focused perspective to ensure user relevance. We illustrate this with a relatively young subfield of XAI, Training Data Attribution (TDA). With the surge in TDA research and growing competition, the field risks repeating the same patterns of solutionism. We conducted a needfinding study with a diverse group of AI practitioners to identify potential user needs related to TDA. Through interviews (N=10) and a systematic survey (N=31), we uncovered new TDA tasks that are currently largely overlooked. We invite the TDA and XAI communities to consider these novel tasks and improve the user relevance of their research outcomes.
arXiv.org Artificial Intelligence
Sep-25-2024
- Country:
- Asia
- British Indian Ocean Territory > Diego Garcia (0.04)
- Singapore > Central Region
- Singapore (0.04)
- South Korea (0.04)
- Europe
- Germany
- Baden-Württemberg > Tübingen Region
- Tübingen (0.14)
- Hamburg (0.04)
- Baden-Württemberg > Tübingen Region
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Germany
- North America
- Dominican Republic (0.04)
- United States
- California (0.04)
- Hawaii > Honolulu County
- Honolulu (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- New York > New York County
- New York City (0.04)
- Virginia (0.04)
- Asia
- Genre:
- Overview (1.00)
- Questionnaire & Opinion Survey (1.00)
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Industry:
- Health & Medicine (1.00)
- Technology: