The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems
Steinmetz, Scott T, Naugle, Asmeret, Schutte, Paul, Sweitzer, Matt, Washburne, Alex, Linville, Lisa, Krofcheck, Daniel, Kucer, Michal, Myren, Samuel
–arXiv.org Artificial Intelligence
The proliferation of powerful AI capabilities and systems necessitates a commensurate focus on user trust. We introduce the Trust Calibration Maturity Model (TCMM) to capture and communicate the maturity of AI system trustworthiness. The TCMM scores maturity along 5 dimensions that drive user trust: Performance Characterization, Bias & Robustness Quantification, Transparency, Safety & Security, and Usability. Information captured in the TCMM can be presented along with system performance information to help a user to appropriately calibrate trust, to compare requirements with current states of development, and to clarify trustworthiness needs. We present the TCMM and demonstrate its use on two AI system-target task pairs.
arXiv.org Artificial Intelligence
Jan-28-2025
- Country:
- Europe > Germany (0.14)
- North America > United States
- New Mexico (0.14)
- Genre:
- Research Report (0.64)
- Industry:
- Energy (1.00)
- Government > Regional Government
- Health & Medicine (0.68)
- Information Technology > Security & Privacy (1.00)
- Technology: