explanation interface
Personalizing explanations of AI-driven hints to users' cognitive abilities: an empirical evaluation
Bahel, Vedant, Sriram, Harshinee, Conati, Cristina
We investigate personalizing the explanations that an Intelligent Tutoring System generates to justify the hints it provides to students to foster their learning. The personalization targets students with low levels of two traits, Need for Cognition and Conscientiousness, and aims to enhance these students' engagement with the explanations, based on prior findings that these students do not naturally engage with the explanations but they would benefit from them if they do. To evaluate the effectiveness of the personalization, we conducted a user study where we found that our proposed personalization significantly increases our target users' interaction with the hint explanations, their understanding of the hints and their learning. Hence, this work provides valuable insights into effectively personalizing AI-driven explanations for cognitively demanding tasks such as learning.
Identifying Reasoning Flaws in Planning-Based RL Using Tree Explanations
Lam, Kin-Ho, Lin, Zhengxian, Irvine, Jed, Dodge, Jonathan, Shureih, Zeyad T, Khanna, Roli, Kahng, Minsuk, Fern, Alan
Enabling humans to identify potential flaws in an agent's decision making is an important Explainable AI application. We consider identifying such flaws in a planning-based deep reinforcement learning (RL) agent for a complex real-time strategy game. In particular, the agent makes decisions via tree search using a learned model and evaluation function over interpretable states and actions. This gives the potential for humans to identify flaws at the level of reasoning steps in the tree, even if the entire reasoning process is too complex to understand. However, it is unclear whether humans will be able to identify such flaws due to the size and complexity of trees. We describe a user interface and case study, where a small group of AI experts and developers attempt to identify reasoning flaws due to inaccurate agent learning. Overall, the interface allowed the group to identify a number of significant flaws of varying types, demonstrating the promise of this approach.
Toward XAI for Intelligent Tutoring Systems: A Case Study
Putnam, Vanessa, Riegel, Lea, Conati, Cristina
Our research is a step toward understanding when explanations of AIdriven hints and feedback are useful in Intelligent Tutoring Systems (ITS). We added an explanation functionality for the adaptive hints provided by the Adaptive CSP (ACSP) applet, an inte lligent interactive simulation that helps students learn an algorithm for constraint satisfaction problems. We present the design of the explanation functionality and the results of an exploratory study to evaluate how students use it, including an analysis of how students' experience with the explanation functionality is affected by several personality traits and abilities . Our results show a significant impact of a measure of curiosity and the Agreeableness personality trait and provide insight toward des igning personalized Explainable AI (XAI) for ITS .