Europe
Identifying and Tracking Switching, Non-Stationary Opponents: A Bayesian Approach
Hernandez-Leal, Pablo (Instituto Nacional de Astrofisica, Optica y Electronica (INAOE)) | Taylor, Matthew E. (Washington State University) | Rosman, Benjamin (University of the Witwatersrand) | Sucar, L. Enrique (Instituto Nacional de Astrofisica, Optica y Electronica (INAOE)) | Cote, Enrique Munoz de (Instituto Nacional de Astrofisica, Optica y Electronica (INAOE))
In many situations, agents are required to use a set of strategies (behaviors) and switch among them during the course of an interaction. This work focuses on the problem of recognizing the strategy used by an agent within a small number of interactions. We propose using a Bayesian framework to address this problem. Bayesian policy reuse (BPR) has been empirically shown to be efficient at correctly detecting the best policy to use from a library in sequential decision tasks. In this paper we extend BPR to adversarial settings, in particular, to opponents that switch from one stationary strategy to another. Our proposed extension enables learning new models in an online fashion when the learning agent detects that the current policies are not performing optimally. Experiments presented in repeated games show that our approach is capable of efficiently detecting opponent strategies and reacting quickly to behavior switches, thereby yielding better performance than state-of-the-art approaches in terms of average rewards.
Ceding Control: Empowering Remote Participants in Meetings involving Smart Conference Rooms
Venkataraman, Vinay (Arizona State University) | Lenchner, Jonathan (IBM Research) | Trewin, Shari (IBM Research) | Ashoori, Maryam (IBM Research) | Guo, Shang (IBM Research) | Dholakia, Mishal (IBM Research) | Turaga, Pavan (Arizona State University)
We present a system that provides an immersive experience to a remote participant collaborating with other participants using a technologically advanced "smart" meeting room. Traditional solutions for virtual collaboration, such as video conferencing or chat rooms, do not allow remote participants to access or control the technological capabilities of such rooms. In this work, we demonstrate a working system for immersive virtual telepresence in a smart conference room that does allow such control.
Analyzing NIH Funding Patterns over Time with Statistical Text Analysis
Park, Jihyun (University of California, Irvine) | Blume-Kohout, Margaret (New Mexico Consortium) | Krestel, Ralf (Hasso Plattner Institut) | Nalisnick, Eric (University of California, Irvine) | Smyth, Padhraic (University of California, Irvine)
In the past few years various government funding organizations such as the U.S. National Institutes of Health and the U.S.\ National Science Foundation have provided access to large publicly-available online databases documenting the grants that they have funded over the past few decades. These databases provide an excellent opportunity for the application of statistical text analysis techniques to infer useful quantitative information about how funding patterns have changed over time. In this paper we analyze data from the National Cancer Institute (part of National Institutes of Health) and show how text classification techniques provide a useful starting point for analyzing how funding for cancer research has evolved over the past 20 years in the United States.
Explorations of Quantum-Classical Approaches to Scheduling a Mars Lander Activity Problem
Tran, Tony T. (University of Toronto) | Wang, Zhihui (National Aeronautics and Space Administration) | Do, Minh (National Aeronautics and Space Administration) | Rieffel, Eleanor G. (National Aeronautics and Space Administration) | Frank, Jeremy (National Aeronautics and Space Administration) | O' (National Aeronautics and Space Administration) | Gorman, Bryan (National Aeronautics and Space Administration) | Venturelli, Davide (University of Toronto) | Beck, J. Christopher
An effective approach to solving problems involving mixed (continuous and discrete) variables and constraints, such as hybrid systems, is to decompose them into subproblems and integrate dedicated solvers geared toward those subproblems. Here, we introduce a new framework based on a tree search algorithm to solve hybrid discrete-continuous problems that incorporates: (1) a quantum annealer that samples from the configuration space for the discrete portion and provides information about the quality of the samples, and (2) a classical computer that makes use of information from the quantum annealer to prune and focus the search as well as check a continuous constraint. We consider four variants of our algorithm, each with progressively more guidance from the results provided by the quantum annealer. We empirically test our algorithm and compare the variants on a simplified Mars Lander task scheduling problem. Variants with more guidance from the quantum annealer have better performance.
A Compilation of the Full PDDL+ Language into SMT
Cashmore, Michael (King's College London) | Fox, Maria (Kings College London) | Long, Derek (Kings College London) | Magazzeni, Daniele (Kings College London)
Planning in hybrid systems is important for dealing with real world applications. PDDL+ supports this representation of domains with mixed discrete and continuous dynamics, and supports events and processes modeling exogenous change. Motivated by numerous SAT-based planning approaches, we propose an approach to PDDL+ planning through SMT, describing an SMT encoding that captures all the features of the PDDL+ problem as published by Fox and Long (2006). The encoding can be applied on domains with nonlinear continuous change. We apply this encoding in a simple planning algorithm, demonstrating excellent results on a set of benchmark problems.
User Participation and Honesty in Online Rating Systems: What a Social Network Can Do
Davoust, Alan (Carleton University) | Esfandiari, Babak (Carleton University)
An important problem with online communities in general, and online rating systems in particular, is uncooperative behavior: lack of user participation, dishonest contributions. This may be due to an incentive structure akin to a Prisoners' Dilemma (PD). We show that introducing an explicit social network to PD games fosters cooperative behavior, and use this insight to design a new aggregation technique for online rating systems. Using a dataset of ratings from Yelp, we show that our aggregation technique outperforms Yelp's proprietary filter, as well as baseline techniques from recommender systems.
Constructive Geometric Constraint Solving as a General Framework for KR-Based Declarative Spatial Reasoning
Schultz, Carl (University of Muenster) | Bhatt, Mehul (University of Bremen)
We present a robust and scalable KR-centered foundation for modularly supporting general declarative spatial representation and reasoning within diverse declarative programming AI frameworks. Based on Constructive Geometric Constraint Solving, our approach provides the foundations for mixed qualitative-quantitative reasoning about space - mereotopology, relative orientation, size, proximity - encompassing key application-driven capabilities such as qualification, spatial consistency solving, quantification, and dynamic geometry. The paper also demonstrates: (a) the framework with benchmark problems (e.g., contact and orientation problems) and applications in spatial Q/A; (b) integration with constraint logic programming, and (c) empirical results illustrating how the proposed encodings outperform existing methods by orders of magnitude on the selected problems.
RELOOP: A Python-Embedded Declarative Language for Relational Optimization
Mladenov, Martin (TU Dortmund University) | Heinrich, Danny (TU Dortmund University) | Kleinhans, Leonard (TU Dortmund University) | Gonsior, Felix (TU Dortmund University) | Kersting, Kristian (TU Dortmund University)
We present RELOOP, a domain-specific language for relational optimization embedded in Python. It allows the user to express relational optimization problems in a natural syntax that follows logic and linear algebra, rather than in the restrictive standard form required by solvers, and can automatically compile the model to a lower-order but equivalent model. Moreover, RELOOP makes it easy to combine relational optimization with high-level features of Python such as loops, parallelism and interfaces to relational databases.
On Declarative Modeling of Structured Pattern Mining
Guns, Tias (KU Leuven) | Paramonov, Sergey (KU Leuven) | Negrevergne, Benjamin (Inria Rennes)
Since the seminal work on frequent itemset mining, there has been considerable effort on mining more structured patterns such as sequences or graphs. Additionally, the field of constraint programming has been linked to the field of pattern mining resulting in a more general and declarative constraint-based itemset mining framework. As a result, a number of recent papers have proposed to extend the declarative approach to structured pattern mining problems. Because the formalism and the solving mechanisms can be vastly different in specialised algorithm and declarative approaches, assessing the benefits and the drawbacks of each approach can be difficult. In this paper, we introduce a framework that formally defines the core components of itemset, sequence and graph mining tasks, and we use it to compare existing specialised algorithms to their declarative counterpart. This analysis allows us to draw clear connections between the two approaches and provide insights on how to overcome current limitations in declarative structured mining.