Plotting

 Country



A Commonsense Knowledge Base for Generating Children’s Stories

AAAI Conferences

This paper presents our work in developing a commonsense knowledge source based on semantic concepts about objects, activities and their relationships in a child’s daily life. This commonsense ontology is then used by our automatic story generator to output children's stories of the fable form from a given input picture. The generated story is a narration of the events of a basic plot that flows from negative to positive (rule violation to value acquisition), using themes that are familiar to children. The paper ends with descriptions of further investigations that are underway to extend the system, including using a formal upper ontology to represent storytelling knowledge, and the generation of stories from a given set of sequential scenes.


Joint Attention in Human-Robot Interaction

AAAI Conferences

We propose a computational model of joint attention consisting of three parts: responding to joint attention, initiating joint attention, and ensuring joint attention. This model is supported by psychological findings and matches the developmental timeline in humans. We present two experiments that test this model and investigate joint attention in human-robot interaction. The first experiment explored the effects of responding to joint attention on human-robot interaction. We show that robots responding to joint attention are more transparent to humans and are more competent and socially interactive. The second experiment studied the importance of ensuring joint attention in human-robot interaction. Data upheld our hypotheses that a robot's ensuring joint attention behavior yields better performance in human-robot interactive tasks and ensuring joint attention behaviors are perceived as natural behaviors.


Cross-Domain Scruffy Inference

AAAI Conferences

Reasoning about Commonsense knowledge poses many problems that traditional logical inference doesn't handle well. Among these is cross-domain inference: how to draw on multiple independently produced knowledge bases. Since knowledge bases may not have the same vocabulary, level of detail, or accuracy, that inference should be "scruffy." The AnalogySpace technique showed that a factored inference approach is useful for approximate reasoning over noisy knowledge bases like ConceptNet. A straightforward extension of factored inference to multiple datasets, called Blending, has seen productive use for commonsense reasoning. We show that Blending is a kind of Collective Matrix Factorization (CMF): the factorization spreads out the prediction loss between each dataset. We then show that blending additional data causes the singular vectors to rotate between the two domains, which enables cross-domain inference. We show, in a simplified example, that the maximum interaction occurs when the magnitudes (as defined by the largest singular values) of the two matrices are equal, confirming previous empirical conclusions. Finally, we describe and mathematically justify Bridge Blending, which facilitates inference between datasets by specifically adding knowledge that "bridges" between the two, in terms of CMF.


Crisis as Reconfiguration of the Economic Complex Adaptive System.

AAAI Conferences

MAMmodels are inherent in CAS as a holistic System. Multi-agent modeling is based on "down-up" Many surprising properties of the Economic Systems (such methodology, starting from the interaction of a multitude as sudden crises, jumps of macro-indices, catastrophe-like of "agents" to revealing the emergent properties of the changes of the system) can be understood deeper on the integral system.


Semantic Oscillations: Encoding Context and Structure in Complex Valued Holographic Vectors

AAAI Conferences

In computational linguistics, information retrieval and applied cognition, words and concepts are often represented as vectors in high dimensional spaces computed from a corpus of text. These high dimensional spaces are often referred to as Semantic Spaces. We describe a novel and efficient approach to computing these semantic spaces via the use of complex valued vector representations. We report on the practical implementation of the proposed method and some associated experiments. We also briefly discuss how the proposed system relates to previous theoretical work in Information Retrieval and Quantum Mechanics and how the notions of probability, logic and geometry are integrated within a single Hilbert space representation. In this sense the proposed system has more general application and gives rise to a variety of opportunities for future research.


Emergence of Self-Sustaining Activation in Dynamically Growing Networks

AAAI Conferences

Here we present a network model in which self-sustaining recurrent activation emerges from simple cascades of activation. It is demonstrated that the ability to support such self-sustaining activation in our model depends on network connectivity as well as the ability to grow new links over time. Additionally, we explore how the probability of emergence of self-sustaining activity can be modulated by changing various network parameters and suggest potential applications of our findings.


Grounding New Words on the Physical World in Multi-Domain Human-Robot Dialogues

AAAI Conferences

This paper summarizes our ongoing project on developing an architecture for a robot that can acquire new words and their meanings while engaging in multi-domain dialogues. These two functions are crucial in making conversational service robots work in real tasks in the real world. Household robots and office robots need to be able to work in multiple task domains and they also need to engage in dialogues in multiple domains corresponding to those task domains. Lexical acquisition is necessary because speech understanding cannot be done without enough knowledge on words that are possibly spoken in the task domain. Our architecture is based on a multi-expert model in which multiple domain experts are employed and one of them is selected based on the user utterance and the situation to engage in the control of the dialogue and physical behaviors. We incorporate experts that have an ability to acquire new lexical entries and their meanings grounded on the physical world through spoken interactions. By appropriately selecting those experts, lexical acquisition in multi-domain dialogues becomes possible. An example robotic system based on this architecture that can acquire object names and location names demonstrates the viability of the architecture.


The Social Medium Is the Message

AAAI Conferences

Robots are being considered for applications where they serve as proxies for humans interacting with another human,such as emergency response, hostage negotiation, and healthcare. In these domains, the human (“dependent”) is connected to multiple other humans (“controllers”) via the robot proxy for long periods of time. The dependent may want to interact with humans but also to engage the robot as a medium to the World Wide Web. In the future, medical personnel may use the robot for victim assistance and comfort while the rescue team plans and monitors extrication. Other applications include healthcare, where the robot is the link between a patient and a medical provider for intermittent,routine interactions, and hostage negotiation, where police may use a bomb squad robot to talk with and build rapport with the suspect while the SWAT team uses the robot’s sensors to build and maintain situation awareness.Under funding from the National Science Foundation, we are finishing the first year of investigating verbal and nonverbal communication strategies for robots who are serving as proxies for multiple humans interact with the humans who are dependent on them. Our work posits that such a robot would occupy a novel social medium position according to the Computers as Social Actors (CASA) model [Nass,Steuer, and Tauber1994] [Reeves and Nass1996]. Given that teleoperated robots are treated socially, it is unlikely that a rescue robot would be treated as a pure medium even if playing music or videos. Likewise, the limitations of autonomy and the interactions of specialists with the dependent prevent the robot from being a true social actor. Instead, social actor and pure medium are two extremes on the agent identity spectrum, with a social medium occupying a middle position.A social medium would be perceived as a loyal, helpful “go between” who is an advocate for the dependent, rather than a device for accomplishing the goals of multiple controllers(medical specialist, structural engineer, rescue operations official, etc.). To explore the social medium identity,we have built a physical prototype of a Survivor Buddy and are creating autonomous affective behaviors and a social medium toolkit to explore human-robot interaction.


Ambiguities in Spatial Language Understanding in Situated Human Robot Dialogue

AAAI Conferences

In human robot dialogue, identifying intended referents from human partners’ spatial language is challenging. This is partly due to automated inference of potentially ambiguous underlying reference system (i.e., frame of reference ). To improve spatial language understanding, we conducted an empirical study to investigate the prevalence of ambiguities of frame of reference. Our findings indicate that ambiguities do arise frequently during human robot dialogues. Although situational factors from the spatial arrangement are less indicative for the underlying reference system, linguistic cues and individual preferences may allow reliable disambiguation.