Azevedo, Roger
Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for education
Hooshyar, Danial, Azevedo, Roger, Yang, Yeongwook
Artificial neural networks (ANNs) have shown to be amongst the most important artificial intelligence (AI) techniques in educational applications, providing adaptive educational services. However, their educational potential is limited in practice due to three major challenges: i) difficulty in incorporating symbolic educational knowledge (e.g., causal relationships, and practitioners' knowledge) in their development, ii) learning and reflecting biases, and iii) lack of interpretability. Given the high-risk nature of education, the integration of educational knowledge into ANNs becomes crucial for developing AI applications that adhere to essential educational restrictions, and provide interpretability over the predictions. This research argues that the neural-symbolic family of AI has the potential to address the named challenges. To this end, it adapts a neural-symbolic AI framework and accordingly develops an approach called NSAI, that injects and extracts educational knowledge into and from deep neural networks, for modelling learners computational thinking. Our findings reveal that the NSAI approach has better generalizability compared to deep neural networks trained merely on training data, as well as training data augmented by SMOTE and autoencoder methods. More importantly, unlike the other models, the NSAI approach prioritises robust representations that capture causal relationships between input features and output labels, ensuring safety in learning to avoid spurious correlations and control biases in training data. Furthermore, the NSAI approach enables the extraction of rules from the learned network, facilitating interpretation and reasoning about the path to predictions, as well as refining the initial educational knowledge. These findings imply that neural-symbolic AI can overcome the limitations of ANNs in education, enabling trustworthy and interpretable applications.
Modeling Player Engagement with Bayesian Hierarchical Models
Sawyer, Robert (North Carolina State University) | Rowe, Jonathan (North Carolina State University) | Azevedo, Roger (University of Central Florida) | Lester, James (North Carolina State University)
Modeling player engagement is a key challenge in games. However, the gameplay signatures of engaged players can be highly context-sensitive, varying based on where the game is used or what population of players is using it. Traditionally, models of player engagement are investigated in a particular context, and it is unclear how effectively these models generalize to other settings and populations. In this work, we investigate a Bayesian hierarchical linear model for multi-task learning to devise a model of player engagement from a pair of datasets that were gathered in two complementary contexts: a Classroom Study with middle school students and a Laboratory Study with undergraduate students. Both groups of players used similar versions of Crystal Island, an educational interactive narrative game for science learning. Results indicate that the Bayesian hierarchical model outperforms both pooled and context-specific models in cross-validation measures of predicting player motivation from in-game behaviors, particularly for the smaller Classroom Study group. Further, we find that the posterior distributions of model parameters indicate that the coefficient for a measure of gameplay performance significantly differs between groups. Drawing upon their capacity to share information across groups, hierarchical Bayesian methods provide an effective approach for modeling player engagement with data from similar, but different, contexts.
Reports of the AAAI 2010 Fall Symposia
Azevedo, Roger (McGill University) | Biswas, Gautam (Vanderbilt University) | Bohus, Dan (Microsoft Research) | Carmichael, Ted (University of North Carolina at Charlotte) | Finlayson, Mark (Massachusetts Institute of Technology) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Havasi, Catherine (Massachusetts Institute of Technology) | Horvitz, Eric (Microsoft Research) | Kanda, Takayuki (ATR Intelligent Robotics and Communications Laboratories) | Koyejo, Oluwasanmi (University of Texas at Austin) | Lawless, William (Paine College) | Lenat, Doug (Cycorp) | Meneguzzi, Felipe (Carnegie Mellon University) | Mutlu, Bilge (University of Wisconsin, Madison) | Oh, Jean (Carnegie Mellon University) | Pirrone, Roberto (University of Palermo) | Raux, Antoine (Honda Research Institute USA) | Sofge, Donald (Naval Research Laboratory) | Sukthankar, Gita (University of Central Florida) | Durme, Benjamin Van (Johns Hopkins University)
The Association for the Advancement of Artificial Intelligence was pleased to present the 2010 Fall Symposium Series, held Thursday through Saturday, November 11-13, at the Westin Arlington Gateway in Arlington, Virginia. The titles of the eight symposia are as follows: (1) Cognitive and Metacognitive Educational Systems; (2) Commonsense Knowledge; (3) Complex Adaptive Systems: Resilience, Robustness, and Evolvability; (4) Computational Models of Narrative; (5) Dialog with Robots; (6) Manifold Learning and Its Applications; (7) Proactive Assistant Agents; and (8) Quantum Informatics for Cognitive, Social, and Semantic Processes. The highlights of each symposium are presented in this report.
Reports of the AAAI 2010 Fall Symposia
Azevedo, Roger (McGill University) | Biswas, Gautam (Vanderbilt University) | Bohus, Dan (Microsoft Research) | Carmichael, Ted (University of North Carolina at Charlotte) | Finlayson, Mark (Massachusetts Institute of Technology) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Havasi, Catherine (Massachusetts Institute of Technology) | Horvitz, Eric (Microsoft Research) | Kanda, Takayuki (ATR Intelligent Robotics and Communications Laboratories) | Koyejo, Oluwasanmi (University of Texas at Austin) | Lawless, William (Paine College) | Lenat, Doug (Cycorp) | Meneguzzi, Felipe (Carnegie Mellon University) | Mutlu, Bilge (University of Wisconsin, Madison) | Oh, Jean (Carnegie Mellon University) | Pirrone, Roberto (University of Palermo) | Raux, Antoine (Honda Research Institute USA) | Sofge, Donald (Naval Research Laboratory) | Sukthankar, Gita (University of Central Florida) | Durme, Benjamin Van (Johns Hopkins University)
The Association for the Advancement of Artificial Intelligence was pleased to present the 2010 Fall Symposium Series, held Thursday through Saturday, November 11-13, at the Westin Arlington Gateway in Arlington, Virginia. The titles of the eight symposia are as follows: (1) Cognitive and Metacognitive Educational Systems; (2) Commonsense Knowledge; (3) Complex Adaptive Systems: Resilience, Robustness, and Evolvability; (4) Computational Models of Narrative; (5) Dialog with Robots; (6) Manifold Learning and Its Applications; (7) Proactive Assistant Agents ; and (8) Quantum Informatics for Cognitive, Social, and Semantic Processes. The highlights of each symposium are presented in this report.
Preface: Meta-Cognitive Educational Systems: One Step Forward
Pirrone, Roberto (University of Palermo) | Azevedo, Roger (McGill University) | Biswas, Gautam (Vanderbilt University)
The AAAI Fall Symposium on Meta-Cognitive Educational - What are the theoretical foundations and how are they articulated Systems: One Step Forward is the second edition of the successful in CBLEs? MCES implemented as CBLEs are designed to interact with - What are the main aspects of metacognition, selfregulation users, and support their learning and decision-making processes. Can MCES actually foster they need to plan their learning activities, to adapt their learners to be self-regulating agents? How can a MCES learning strategies to meet learning goals, become aware of be autonomous and increase its knowledge to match the changing task conditions, and the dynamic aspects of the learners evolving skills and knowledge? MCES may not be embodied, prior to, during, and after they have been involved in but does it help if they act as intentional agents? the learning environment.
The Role of Prompting and Feedback in Facilitating Studentsโ Learning about Science with MetaTutor
Azevedo, Roger (McGill University) | Johnson, Amy (University of Memphis) | Burkett, Candice (University of Memphis) | Chauncey, Amber (University of Memphis) | Lintean, Mihai ( University of Memphis ) | Cai, Zhiqiang (University of Memphis) | Rus, Vasile (University of Memphis)
An experiment was conducted to test the efficacy of a new intelligent hypermedia system, MetaTutor, which is intended to prompt and scaffold the use of self-regulated learning (SRL) processes during learning about a human body system. Sixty-eight (N=68) undergraduate students learned about the human circulatory system under one of three conditions: prompt and feedback (PF), prompt-only (PO), and control (C) condition. The PF condition received timely prompts from animated pedagogical agents to engage in planning processes, monitoring processes, and learning strategies and also received immediate directive feedback from the agents concerning the deployment of the processes. The PO condition received the same timely prompts, but did not receive any feedback following the deployment of the processes. Finally, the control condition learned without any assistance from the agents during the learning session. All participants had two hours to learn using a 41-page hypermedia environment which included texts describing and static diagrams depicting various topics concerning the human circulatory system. Results indicate that the PF condition had significantly higher learning efficiency scores, when compared to the control condition. There were no significant differences between the PF and PO conditions. These results are discussed in the context of development of a fully-adaptive hypermedia learning system intended to scaffold self-regulated learning.
Dysregulated Learning with Advanced Learning Technologies
Azevedo, Roger (McGill University) | Feyzi-Behnagh, Reza (McGill University)
Successful learning with advanced learning technologies is based on the premise that learners adaptively regulate their cognitive and metacognitive behaviors during learning. However, there is abundant empirical evidence that suggests that learners typically do not adaptively modify their behavior, thus suggesting that they engage in what is called dysregulated behavior. Dysregulated learning is a new term that is used to describe a class of behaviors that learners use that lead to minimal learning. Examples of dysregulated learning include failures to: (1) encode contextual demands, (2) deploy effective learning strategies, (3) modify and update internal standards, (4) deal with the dynamic nature of the task, (5) metacognitive monitor the use of strategies and repeatedly make accurate metacognitive judgments, and (6) intelligently adapt behavior during learning so as to maximize learning and understanding of the instructional material. Understanding behaviors associated with dysregulated learning is critical since it has implications for determining what they are, when they occur, how often they occur, and how they can be corrected during learning.
Reports of the AAAI 2009 Fall Symposia
Azevedo, Roger (University of Memphis) | Bench-Capon, Trevor (University of Liverpool) | Biswas, Gautam (Vanderbilt University) | Carmichael, Ted (University of North Carolina at Charlotte) | Green, Nancy (University of North Carolina at Greensboro) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Koyejo, Oluwasanmi (University of Texas) | Kurup, Unmesh (Rensselaer Polytechnic Institute) | Parsons, Simon (Brooklyn College, City University of New York) | Pirrone, Roberto (University of Pirrone) | Prakken, Henry (Utrecht University) | Samsonovich, Alexei (George Mason University) | Scott, Donia (Open University) | Souvenir, Richard (University of North Carolina at Charlotte)
The Association for the Advancement of Artificial Intelligence was pleased to present the 2009 Fall Symposium Series, held Thursday through Saturday, November 5โ7, at the Westin Arlington Gateway in Arlington, Virginia. The Symposium Series was preceded on Wednesday, November 4 by a one-day AI funding seminar. The titles of the seven symposia were as follows: (1) Biologically Inspired Cognitive Architectures, (2) Cognitive and Metacognitive Educational Systems, (3) Complex Adaptive Systems and the Threshold Effect: Views from the Natural and Social Sciences, (4) Manifold Learning and Its Applications, (5) Multirepresentational Architectures for Human-Level Intelligence, (6) The Uses of Computational Argumentation, and (7) Virtual Healthcare Interaction.
Reports of the AAAI 2009 Fall Symposia
Azevedo, Roger (University of Memphis) | Bench-Capon, Trevor (University of Liverpool) | Biswas, Gautam (Vanderbilt University) | Carmichael, Ted (University of North Carolina at Charlotte) | Green, Nancy (University of North Carolina at Greensboro) | Hadzikadic, Mirsad (University of North Carolina at Charlotte) | Koyejo, Oluwasanmi (University of Texas) | Kurup, Unmesh (Rensselaer Polytechnic Institute) | Parsons, Simon (Brooklyn College, City University of New York) | Pirrone, Roberto (University of Pirrone) | Prakken, Henry (Utrecht University) | Samsonovich, Alexei (George Mason University) | Scott, Donia (Open University) | Souvenir, Richard (University of North Carolina at Charlotte)
Series, held Thursday through Saturday, November 5-7, at he Association for the Advancement of Artificial Intelligence the Westin Arlington Gateway in Arlington, Virginia. The titles of the seven symposia were as follows: (1) Biologically Inspired Cognitive Biologically Inspired Cognitive Architectures Architectures, (2) Cognitive and Metacognitive Cognitive and Metacognitive Educational Systems Educational Systems, (3) Complex Adaptive Complex Adaptive Systems and the Threshold Effect: Views from the Natural Systems and the Threshold Effect: Views and Social Sciences from the Natural and Social Sciences, (4) Manifold Manifold Learning and Its Applications Learning and Its Applications, (5) Multirepresentational Architectures for Human-Level Multirepresentational Architectures for Human-Level Intelligence Intelligence, (6) The Uses of Computational The Uses of Computational Argumentation Argumentation, and (7) Virtual Healthcare Virtual Healthcare Interaction Interaction. An informal reception was held on Thursday, November 5. A general plenary session, in which the highlights of each symposium were presented, was held on Friday, November 6. The challenge of creating a real-life computational equivalent of the human mind requires that we better understand at a computational level how natural intelligent systems develop their cognitive and learning functions. They will behave, variety of disjoined communities and schools of learn, communicate, and "think" as conscious thought that used to speak different languages and beings in general, in addition to being able to perform ignore each other.
Preface
Pirrone, Roberto (University of Palermo) | Azevedo, Roger (Vanderbilt University) | Biswas, Gautam
Artificial learning systems such as e-learning, multimedia Human or artificial tutors have to continuously and dynamically and hypermedia, and Intelligent Tutoring Systems (ITS) monitor and model all of the students activities are designed to support learning processes in order to facilitate (including problem solving processes, deployment of regulatory the acquisition, development, use, and transfer required processes, and so on), make complicated inferences to solve complex tasks. Besides their trivial duties about them, to ensure that learning is maximized. Students regarding content management, these systems have to interact and tutors need decision support capabilities in terms of social with different users, and support them with several decisional networks analysis, visualization tools of students behaviors processes. One of the most critical decisions includes in relation to the domain knowledge to be explored, those dealing with aspects of self-regulation. A paradigm shift changing task conditions, and dynamic aspects of the instructional is needed in this respect.