Doherty, Patrick
Techniques for Measuring the Inferential Strength of Forgetting Policies
Doherty, Patrick, Szalas, Andrzej
The technique of forgetting in knowledge representation has been shown to be a powerful and useful knowledge engineering tool with widespread application. Yet, very little research has been done on how different policies of forgetting, or use of different forgetting operators, affects the inferential strength of the original theory. The goal of this paper is to define loss functions for measuring changes in inferential strength based on intuitions from model counting and probability theory. Properties of such loss measures are studied and a pragmatic knowledge engineering tool is proposed for computing loss measures using Problog. The paper includes a working methodology for studying and determining the strength of different forgetting policies, in addition to concrete examples showing how to apply the theoretical results using Problog. Although the focus is on forgetting, the results are much more general and should have wider application to other areas.
Dual Forgetting Operators in the Context of Weakest Sufficient and Strongest Necessary Conditions
Doherty, Patrick, Szalas, Andrzej
Forgetting is an important concept in knowledge representation and automated reasoning with widespread applications across a number of disciplines. A standard forgetting operator, characterized in [Lin and Reiter'94] in terms of model-theoretic semantics and primarily focusing on the propositional case, opened up a new research subarea. In this paper, a new operator called weak forgetting, dual to standard forgetting, is introduced and both together are shown to offer a new more uniform perspective on forgetting operators in general. Both the weak and standard forgetting operators are characterized in terms of entailment and inference, rather than a model theoretic semantics. This naturally leads to a useful algorithmic perspective based on quantifier elimination and the use of Ackermman's Lemma and its fixpoint generalization. The strong formal relationship between standard forgetting and strongest necessary conditions and weak forgetting and weakest sufficient conditions is also characterized quite naturally through the entailment-based, inferential perspective used. The framework used to characterize the dual forgetting operators is also generalized to the first-order case and includes useful algorithms for computing first-order forgetting operators in special cases. Practical examples are also included to show the importance of both weak and standard forgetting in modeling and representation.
Planning with Temporal Uncertainty, Resources and Non-Linear Control Parameters
Nilsson, Mikael (Linköping University) | Kvarnström, Jonas (Linköping University) | Doherty, Patrick (Linköping University)
We consider a general and industrially motivated class of planning problems involving a combination of requirements that can be essential to autonomous robotic systems planning to act in the real world: Support for temporal uncertainty where nature determines the eventual duration of an action, resource consumption with a non-linear relationship to durations, and the need to select appropriate values for control parameters that affect time requirements and resource usage. To this end, an existing planner is extended with support for Simple Temporal Networks with Uncertainty, Timed Initial Literals, and temporal coverage goals. Control parameters are lifted from the main combinatorial planning problem into a constraint satisfaction problem that connects them to resource usage. Constraint processing is then integrated and interleaved with verification of temporal feasibility, using projections for partial temporal awareness in the constraint solver.
Deep Learning Quadcopter Control via Risk-Aware Active Learning
Andersson, Olov (Linköping University) | Wzorek, Mariusz (Linköping University) | Doherty, Patrick (Linköping University)
Modern optimization-based approaches to control increasingly allow automatic generation of complex behavior from only a model and an objective. Recent years has seen growing interest in fast solvers to also allow real-time operation on robots, but the computational cost of such trajectory optimization remains prohibitive for many applications. In this paper we examine a novel deep neural network approximation and validate it on a safe navigation problem with a real nano-quadcopter. As the risk of costly failures is a major concern with real robots, we propose a risk-aware resampling technique. Contrary to prior work this active learning approach is easy to use with existing solvers for trajectory optimization, as well as deep learning. We demonstrate the efficacy of the approach on a difficult collision avoidance problem with non-cooperative moving obstacles. Our findings indicate that the resulting neural network approximations are least 50 times faster than the trajectory optimizer while still satisfying the safety requirements. We demonstrate the potential of the approach by implementing a synthesized deep neural network policy on the nano-quadcopter microcontroller.
Model-Based Reinforcement Learning in Continuous Environments Using Real-Time Constrained Optimization
Andersson, Olov (Linköping University) | Heintz, Fredrik (Linköping University) | Doherty, Patrick (Linköping University)
Reinforcement learning for robot control tasks in continuous environments is a challenging problem due to the dimensionality of the state and action spaces, time and resource costs for learning with a real robot as well as constraints imposed for its safe operation. In this paper we propose a model-based reinforcement learning approach for continuous environments with constraints. The approach combines model-based reinforcement learning with recent advances in approximate optimal control. This results in a bounded-rationality agent that makes decisions in real-time by efficiently solving a sequence of constrained optimization problems on learned sparse Gaussian process models. Such a combination has several advantages. No high-dimensional policy needs to be computed or stored while the learning problem often reduces to a set of lower-dimensional models of the dynamics. In addition, hard constraints can easily be included and objectives can also be changed in real-time to allow for multiple or dynamic tasks. The efficacy of the approach is demonstrated on both an extended cart pole domain and a challenging quadcopter navigation task using real data.
Reports of the AAAI 2011 Spring Symposia
Buller, Mark (Brown University) | Cuddihy, Paul (General Electric Research) | Davis, Ernest (New York University) | Doherty, Patrick (Linkoping University) | Doshi-Velez, Finale (Massachusetts Institute of Technology) | Erdem, Esra (Sabanci University) | Fisher, Douglas (Vanderbilt University) | Green, Nancy (University of North Carolina, Greensboro) | Hinkelmann, Knut (University of Applied Sciences Northwestern Switzerland FHNW) | Maher, Mary Lou (University of Maryland) | McLurkin, James (Rice University) | Maheswaran, Rajiv (University of Southern California) | Rubinelli, Sara (University of Lucerne) | Schurr, Nathan (Aptima, Inc.) | Scott, Donia (University of Sussex) | Shell, Dylan (Texas A&M University) | Szekely, Pedro (University of Southern California) | Thönssen, Barbara (University of Applied Sciences Northwestern Switzerland FHNW) | Urken, Arnold B. (University of Arizona)
The Association for the Advancement of Artificial Intelligence, in cooperation with Stanford University's Department of Computer Science, presented the 2011 Spring Symposium Series Monday through Wednesday, March 21–23, 2011 at Stanford University. The titles of the eight symposia were AI and Health Communication, Artificial Intelligence and Sustainable Design, AI for Business Agility, Computational Physiology, Help Me Help You: Bridging the Gaps in Human-Agent Collaboration, Logical Formalizations of Commonsense Reasoning, Multirobot Systems and Physical Data Structures, and Modeling Complex Adaptive Systems As If They Were Voting Processes.
Reports of the AAAI 2011 Spring Symposia
Buller, Mark (Brown University) | Cuddihy, Paul (General Electric Research) | Davis, Ernest (New York University) | Doherty, Patrick (Linkoping University) | Doshi-Velez, Finale (Massachusetts Institute of Technology) | Erdem, Esra (Sabanci University) | Fisher, Douglas (Vanderbilt University) | Green, Nancy (University of North Carolina, Greensboro) | Hinkelmann, Knut (University of Applied Sciences Northwestern Switzerland FHNW) | Maher, Mary Lou (University of Maryland) | McLurkin, James (Rice University) | Maheswaran, Rajiv (University of Southern California) | Rubinelli, Sara (University of Lucerne) | Schurr, Nathan (Aptima, Inc.) | Scott, Donia (University of Sussex) | Shell, Dylan (Texas A&M University) | Szekely, Pedro (University of Southern California) | Thönssen, Barbara (University of Applied Sciences Northwestern Switzerland FHNW) | Urken, Arnold B. (University of Arizona)
The titles of the eight symposia were Artificial Intelligence and Health Communication, Artificial Intelligence and Sustainable Design, Artificial Intelligence for Business Agility, Computational Physiology, Help Me Help You: Bridging the Gaps in Human-Agent Collaboration, Logical Formalizations of Commonsense Reasoning, Multirobot Systems and Physical Data Structures, and Modeling Complex Adaptive Systems As If They Were Voting Processes. The goal of the Artificial Intelligence and Health Communication symposium was to advance the conceptual design of automated systems that provide health services to patients and consumers through interdisciplinary insight from artificial intelligence, health communication and related areas of communication studies, discourse studies, public health, and psychology. There is a large and growing interest in the development of automated systems to provide health services to patients and consumers. In the last two decades, applications informed by research in health communication have been developed, for example, for promoting healthy behavior and for managing chronic diseases. While the value that these types of applications can offer to the community in terms of cost, access, and convenience is clear, there are still major challenges facing design of effective health communication systems. Overall, the participants found the format of the symposium engaging and constructive, and they The symposium was organized around five main expressed the desire to continue this initiative in concepts: (1) Patient empowerment and education further events.
Organizing Committee
Davis, Ernest (New York University) | Doherty, Patrick (Linkoping University) | Erdem, Esra (Sabanci University)
Choosing Path Replanning Strategies for Unmanned Aircraft Systems
Wzorek, Mariusz (Linköping University) | Kvarnström, Jonas (Linköping University) | Doherty, Patrick (Linköping University)
Unmanned aircraft systems use a variety of techniques to plan collision-free flight paths given a map of obstacles and no-fly zones. However, maps are not perfect and obstacles may change over time or be detected during flight, which may invalidate paths that the aircraft is already following. Thus, dynamic in-flight replanning is required. Numerous strategies can be used for replanning, where the time requirements and the plan quality associated with each strategy depend on the environment around the original flight path. In this paper, we investigate the use of machine learning techniques, in particular support vector machines, to choose the best possible replanning strategy depending on the amount of time available. The system has been implemented, integrated and tested in hardware-in-the-loop simulation with a Yamaha RMAX helicopter platform.
Stream-Based Middleware Support for Embedded Reasoning
Heintz, Fredrik (Linköping University) | Kvarnström, Jonas (Linköping University) | Doherty, Patrick (Linköping University)
For autonomous systems such as unmanned aerial vehicles tosuccessfully perform complex missions, a great deal of embedded reasoning is required at varying levels of abstraction. In order to make use of diverse reasoning modules in such systems, issues ofintegration such as sensor data flow and information flow between such modules has to be taken into account. The DyKnow framework is a tool with a formal basis that pragmatically deals with many of the architectural issues which arise in such systems. This includes a systematic stream-based method for handling the sense-reasoning gap,caused by the wide difference in abstraction levels between the noisy data generally available from sensors and the symbolic, semantically meaningful information required by many high-level reasoning modules. DyKnow has proven to be quite robust and widely applicable to different aspects of hybrid software architectures forrobotics. In this paper, we describe the DyKnow framework and show how it is integrated and used in unmanned aerial vehicle systems developed in our group. In particular, we focus on issues pertaining to the sense-reasoning gap and the symbol grounding problem and the use of DyKnow as a means of generating semantic structures representing situational awareness for such systems. We also discuss the use of DyKnow in the context of automated planning, in particular execution monitoring.