This paper proposes a novel agenda for cognitive systems research focused on the "social agency" problem, which concerns acting to produce mental states in other agents in addition to physical states of the world. The capacity for social agency will enable agents to perform a wide array of tasks in close association with people and is a valuable first step towards broader social cognition. We argue that existing cognitive systems have not addressed social agency because they lack a number of the required mechanisms. We describe an initial approach set in a toy scenario based on capabilities native to the ICARUS cognitive architecture. We utilize an analysis of this approach to highlight the open issues required for social agency and to encourage other researchers to address this important problem.

This article proposes a suite of design decisions for the overall design of an Artificial Intelligence, i.e., a software system that exhibits intelligence in the spirit of the early days of A.I. research. The key aspects of the proposal are: (1) The identification of the A.I. system as a software individual that has the properties of integrity and persistence; (2) The construction of a software platform that integrates aspects of incremental programming languages and systems as well as of operating systems, with aspects that are intrinsic to knowledge-based artificial intelligence; (3) The use of a representation language that builds on essential aspects of S-expressions, Lisp, logic and extended set theory, but which is used both as a vehicle for software and as a publication language e.g. in lecture notes; (4) The identification of actions and aggregates of actions as first-class citizens in the representation language and as an important type of data object in the software system. The article also describes the Leonardo software platform, its representation language, its educational resources and its knowledgebase library which is one implementation of these proposed design decisions. Finally it makes a proposal concerning the research paradigm for this research area.

Simulation techniques have long sustained research in various domains of physical, biological, and social sciences. Currently, humanists are exploring the usefulness of simulations for addressing various research questions. The nature and challenges of this enterprise are presented here in respect to collaborative work, the relation of humanities to the sciences, the transformative nature of digital methods of research within the humanities. This article describes a coordinated attempt to pursue these issues via a Summer Institute funded by the National Endowment for the Humanities, and briefly notes the projects of three of the Institute’s participants. Their work is described in detail elsewhere within this volume.

We present an evaluation methodology and a system for ranking questions within the context of a multimodal tutorial dialogue. Such a framework has applications for automatic question selection and generation in intelligent tutoring systems. To create this ranking system we manually author candidate questions for specific points in a dialogue and have raters assign scores to these questions. To explore the role of question type in scoring, we annotate dialogue turns with labels from the DISCUSS dialogue move taxonomy. Questions are ranked using a SVM-regression model trained with features extracted from the dialogue context, the candidate question, and the human ratings. Evaluation shows that our system’s rankings correlate with human judgments in question ranking.

This paper discusses the implementation and evaluation of automatically generated cloze questions in the style of the definitions found in Collins COBUILD English language learner’s dictionary. The definitions and the cloze questions are used in an automated reading tutor to help second and third grade students learn new vocabulary. A parser provides syntactic phrase structure trees for the definitions. With these parse trees as input, a pattern matching program uses a set of syntactic patterns to extract the phrases that make up the cloze question answers and distracters.

This paper shows that automatically generated questions can help classify children’s spoken responses to a reading tutor teaching them to generate their own questions. We use automatic question generation to model and classify children’s prompted spoken questions about stories. On distinguishing complete and incomplete questions from irrelevant speech and silence, a language model built from automatically generated questions out-performs a trigram language model that does not exploit the structure of questions.

This paper argues the position that an essential approach to the advancement of the state of the art in cognitive systems is to focus on systems that deeply integrate knowledge representations, cognitive capabilities, and knowledge content. Integration is the path to aggregating constraints in ways that improve the science of cognitive systems. However, evaluating the role of knowledge among these constraints has largely been ignored, in part because it is difficult to build and evaluate systems that incorporate large amounts of knowledge. We provide suggestions for evaluating such systems and argue that such evaluations will become easier as we come closer to applying usefully new, integrated learning mechanisms that are capable of acquiring large and effective knowledge bases.

Researchers have studied problems in metacognition both in computers and in humans. In response some have implemented models of cognition and metacognitive activity in various architectures to test and better define specific theories of metacognition. However, current theories and implementations suffer from numerous problems and lack of detail. Here we illustrate the problems with two different computational approaches. The Meta-Cognitive Loop and Meta-AQUA both examine the metacognitive reasoning involved in monitoring and reasoning about failures of expectations, and they both learn from such experiences. But neither system presents a full accounting of the variety of known metacognitive phenomena, and, as far as we know, no extant system does. The problem is that no existing cognitive architecture directly addresses metacognition. Instead, current architectures were initially developed to study more narrow cognitive functions and only later were they modified to include higher level attributes. We claim that the solution is to develop a metacognitive architecture outright, and we begin to outline the structure that such a foundation might have.

Good readers ask questions during reading, and this is presumed to improve their text comprehension. But what about not-so-good readers? Does question asking promote comprehension for struggling readers and, if so, how can we best support these students? This paper examines question generation among low-performing sixth-graders who read moderately-challenging science texts. It characterizes the nature of students’ questions and describes the effects of a video-based peer modeling intervention on their question asking and reading comprehension. In contrast to previous research, this study found that students asked a large number of deep reasoning questions, particularly those related to identifying goals, processes, causes, and consequences. However, such questions were not generally associated with greater understanding. Only two types of deep reasoning questions were related to text comprehension—those that were not answered in the text (directly or indirectly) and those that students labeled as “I’m Confused” questions. The study also found that readers who were exposed to video-based peer modeling of question generation asked more of these types of questions and scored significantly higher on multiple measures of text comprehension. These findings have implications for the design of systems to support struggling readers and for theory-building about question generation.

Automated question generation has been explored for a broad range of tasks. However, an important task for which limited work on question generation has been undertaken is writing support. Writing support systems, particularly for novice writers who are acquiring the fundamentals of writing, can scaffold the complex processes that bear on writing. Novice writers face significant challenges in creative writing. Their stories often lack the expressive prose that characterizes texts produced by their expert writer counterparts. A story that is composed by a novice writer may also lack a compelling plot, may not effectively utilize a story’s setting, characters, and props, and may describe events that play out in an unpredictable or confusing order. We propose an automatic question generation framework that is designed to stimulate the cognitive processes associated with creative writing. The framework utilizes semantic role labeling and discourse parsing applied to the initial drafts of the writer’s passage to generate questions to promote creativity.