Instructional Material
Interactive Concept Maps and Learning Outcomes in Guru
Person, Natalie K. (Rhodes College) | Olney, Andrew M. (University of Memphis) | D' (University of Notre Dame) | Mello, Sidney K. (University of Memphis) | Lehman, Blair A.
Concept maps are frequently used in K-12 educational settings. The purpose of this study is to determine whether students’ performance on interactive concept map tasks in Guru, an intelligent tutoring system, is related to immediate and delayed learning outcomes. Guru is a dialogue-based system for high-school biology that intersperses concept map tasks within the tutorial dialogue. Results indicated that when students first attempt to complete concept maps, time spent on the maps may be a good indicator of their understanding, whereas the errors they make on their second attempts with the maps may be an indicator of the knowledge they are lacking. This pattern of results was observed for one cycle of testing, but not replicated in a second cycle. Differences in the findings for the two testing cycles are most likely due to topic variations.
Modeling the Effects of International Interventions with Nexus Network Learne
Duong, Deborah V. (Agent Based Learning Systems)
Nexus Network Learner is an intelligent agent based simulation used to study Irregular Warfare (IW) in several major studies at the Department of Defense (DoD). Heterogeneous autonomous agents, each with their own separated inductive learning mechanism, have initial attributes and behaviors in proportion to demographic groups in the simulated population, and learn new behaviors as they serve culturally based goals. Nexus agents create a dynamic role-based network, and learn how to choose partners as well as what behaviors they should have with their network partners. As Nexus agents coevolve, nexus models the emergence of social institutions from individual behaviors, the fundamental social aggregation challenge. Nexus models the formation of learned vicious and virtuous cycles of behavior, some of which have higher average utility for the agents than others, and can be used to test the effects of interventions on the natural motivation-based system. An experiment is presented that uses Nexus to model the vicious cycle of corruption in an African country, from the first Irregular Warfare Analytical baseline at the Office of the Secretary of Defense (Messer 2009).
The Aggregative Contingent Estimation System: Selecting, Rewarding, and Training Experts in a Wisdom of Crowds Approach to Forecasting
Warnaar, Dirk B. (Applied Research Associates) | Merkle, Edgar C. (University of Missouri) | Steyvers, Mark (University of California, Irvine) | Wallsten, Thomas S. (University of Maryland) | Stone, Eric R. (Wake Forest University) | Budescu, David V. (Fordham University) | Yates, J. Frank (University of Michigan) | Sieck, Winston R. (Global Cognition) | Arkes, Hal R. (The Ohio State University) | Argenta, Chris F. (Applied Research Associates) | Shin, Youngwon (Applied Research Associates) | Carter, Jennifer N. (Applied Research Associates)
You Too?! Mixed-Initiative LDA Story Matching to Help Teens in Distress
Dinakar, Karthik (Massachusetts Institute of Technology) | Jones, Birago (Massachusetts Institute of Technology) | Lieberman, Henry (Massachusetts Institute of Technology) | Picard, Rosalind (Massachusetts Institute of Technology) | Rose, Carolyn (Carnegie Mellon University) | Thoman, Matthew (Northeastern University) | Reichart, Roi (Massachusetts Institute of Technology)
Adolescent cyber-bullying on social networks is a phenomenon that has received widespread attention. Recent work by sociologists has examined this phenomenon under the larger context of teenage drama and it's manifestations on social networks. Tackling cyber-bullying involves two key components – automatic detection of possible cases, and interaction strategies that encourage reflection and emotional support. Key is showing distressed teenagers that they are not alone in their plight. Conventional topic spotting and document classification into labels like "dating" or "sports" are not enough to effectively match stories for this task. In this work, we examine a corpus of 5500 stories from distressed teenagers from a major youth social network. We combine Latent Dirichlet Allocation and human interpretation of its output using principles from sociolinguistics to extract high-level themes in the stories and use them to match new stories to similar ones. A user evaluation of the story matching shows that theme-based retrieval does a better job of finding relevant and effective stories for this application than conventional approaches.
Tutorials
Breslin, John (National University of Ireland, Galway)
The ICWSM 2012 conference tutorials will be How to Analyze Massive Social Network Datasets without a Cluster, presented by Derek Ruths; Charting Collections of Connections in Social Media: Creating Maps and Measures with NodeXL, presented by Marc Smith; Evidenced-Based Social Design of Online Communities: Getting to Critical Mass and Encouraging Contributions, presented by Paul Resnick and Robert Kraut; Sentiment Mining from User Generated Content, presented by Lyle Ungar and Ronen Feldman; and Information Extraction for Social Media Anaylsis, presented by Denilson Barbosa.
Towards an Intelligent Tutor for Mathematical Proofs
Autexier, Serge, Dietrich, Dominik, Schiller, Marvin
Computer-supported learning is an increasingly important form of study since it allows for independent learning and individualized instruction. In this paper, we discuss a novel approach to developing an intelligent tutoring system for teaching textbook-style mathematical proofs. We characterize the particularities of the domain and discuss common ITS design models. Our approach is motivated by phenomena found in a corpus of tutorial dialogs that were collected in a Wizard-of-Oz experiment. We show how an intelligent tutor for textbook-style mathematical proofs can be built on top of an adapted assertion-level proof assistant by reusing representations and proof search strategies originally developed for automated and interactive theorem proving. The resulting prototype was successfully evaluated on a corpus of tutorial dialogs and yields good results.
Unfair items detection in educational measurement
Measurement professionals cannot come to an agreement on the definition of the term 'item fairness'. In this paper a continuous measure of item unfairness is proposed. The more the unfairness measure deviates from zero, the less fair the item is. If the measure exceeds the cutoff value, the item is identified as definitely unfair. The new approach can identify unfair items that would not be identified with conventional procedures. The results are in accord with experts' judgments on the item qualities. Since no assumptions about scores distributions and/or correlations are assumed, the method is applicable to any educational test. Its performance is illustrated through application to scores of a real test.
Abstract Normative Systems: Semantics and Proof Theory
Tosatto, Silvano Colombo (University of Luxembourg) | Boella, Guido (University of Turin) | Torre, Leendert van der (University of Luxembourg) | Villata, Serena (INRIA)
In this paper we introduce an abstract theory of normative reasoning, whose central notion is the generation of obligations, permissions and institutional facts from conditional norms. We present various semantics and their proof systems. The theory can be used to classify and compare new candidates for standards of normative reasoning, and to explore more elaborate forms of normative reasoning than studied thus far.
Specifying and Reasoning with Underspecified Knowledge Bases Using Answer Set Programming
Chaudhri, Vinay K. (SRI International) | Son, Tran Cao (New Mexico State University)
A large and complex knowledge base that models some aspect of the real world can rarely be fully specified. Two examples of such underspecification are that (i) some of the cardinality constraints are omitted; (ii) some properties of all individual instances of a class are specialized across a class hierarchy, but specific references to which particular values are specialized are omitted. Such knowledge bases are of great practical interest as they are the basis of an empirically tested knowledge acquisition system that has been used to construct a knowledge base from a significant portion of a biology textbook. In this paper, we formalize an underspecified knowledge base using answer set programming, and give a set of rules called UMAP that support inheritance reasoning in such a knowledge base.
Noise Thresholds for Spectral Clustering
Balakrishnan, Sivaraman, Xu, Min, Krishnamurthy, Akshay, Singh, Aarti
Although spectral clustering has enjoyed considerable empirical success in machine learning, its theoretical properties are not yet fully developed. We analyze the performance of a spectral algorithm for hierarchical clustering and show that on a class of hierarchically structured similarity matrices, this algorithm can tolerate noise that grows with the number of data points while still perfectly recovering the hierarchical clusters with high probability. We additionally improve upon previous results for k-way spectral clustering to derive conditions under which spectral clustering makes no mistakes. Further, using minimax analysis, we derive tight upper and lower bounds for the clustering problem and compare the performance of spectral clustering to these information theoretic limits. We also present experiments on simulated and real world data illustrating our results.