Spatial Reasoning
Gesture Unit Segmentation Using Spatial-Temporal Information and Machine Learning
Wagner, Priscilla Koch (University of São Paulo) | Peres, Sarajane Marques (University of São Paulo) | Madeo, Renata Cristina Barros (Uninove) | Lima, Clodoaldo Aparecido de Moraes (University of São Paulo) | Freitas, Fernando de Almeida (University of São Paulo and Incluir Tecnologia)
Currently, automated gesture analysis is being widely used in different research areas, such as human-computer interaction or human-behavior analysis. With regard to the latter area in particular, gesture analysis is closely related to studies on human communication. Linguists and psycholinguists analyze gestures from several standpoints, and one of them is the analysis of gesture segments. The aim of this paper is to outline an approach to automate gesture unit segmentation, as a way of assisting linguistic studies. This objective was attained by employing a Machine Learning technique with the aid of a spatial-temporal data representation.
Latent Self-Exciting Point Process Model for Spatial-Temporal Networks
Cho, Yoon-Sik, Galstyan, Aram, Brantingham, P. Jeffrey, Tita, George
We propose a latent self-exciting point process model that describes geographically distributed interactions between pairs of entities. In contrast to most existing approaches that assume fully observable interactions, here we consider a scenario where certain interaction events lack information about participants. Instead, this information needs to be inferred from the available observations. We develop an efficient approximate algorithm based on variational expectation-maximization to infer unknown participants in an event given the location and the time of the event. We validate the model on synthetic as well as real-world data, and obtain very promising results on the identity-inference task. We also use our model to predict the timing and participants of future events, and demonstrate that it compares favorably with baseline approaches.
Factorized Point Process Intensities: A Spatial Analysis of Professional Basketball
Miller, Andrew, Bornn, Luke, Adams, Ryan, Goldsberry, Kirk
We develop a machine learning approach to represent and analyze the underlying spatial structure that governs shot selection among professional basketball players in the NBA. Typically, NBA players are discussed and compared in an heuristic, imprecise manner that relies on unmeasured intuitions about player behavior. This makes it difficult to draw comparisons between players and make accurate player specific predictions. Modeling shot attempt data as a point process, we create a low dimensional representation of offensive player types in the NBA. Using non-negative matrix factorization (NMF), an unsupervised dimensionality reduction technique, we show that a low-rank spatial decomposition summarizes the shooting habits of NBA players. The spatial representations discovered by the algorithm correspond to intuitive descriptions of NBA player types, and can be used to model other spatial effects, such as shooting accuracy.
Geospatial Narratives and their Spatio-Temporal Dynamics: Commonsense Reasoning for High-level Analyses in Geographic Information Systems
Bhatt, Mehul, Wallgruen, Jan Oliver
The modelling, analysis, and visualisation of dynamic geospatial phenomena has been identified as a key developmental challenge for next-generation Geographic Information Systems (GIS). In this context, the envisaged paradigmatic extensions to contemporary foundational GIS technology raises fundamental questions concerning the ontological, formal representational, and (analytical) computational methods that would underlie their spatial information theoretic underpinnings. We present the conceptual overview and architecture for the development of high-level semantic and qualitative analytical capabilities for dynamic geospatial domains. Building on formal methods in the areas of commonsense reasoning, qualitative reasoning, spatial and temporal representation and reasoning, reasoning about actions and change, and computational models of narrative, we identify concrete theoretical and practical challenges that accrue in the context of formal reasoning about `space, events, actions, and change'. With this as a basis, and within the backdrop of an illustrated scenario involving the spatio-temporal dynamics of urban narratives, we address specific problems and solutions techniques chiefly involving `qualitative abstraction', `data integration and spatial consistency', and `practical geospatial abduction'. From a broad topical viewpoint, we propose that next-generation dynamic GIS technology demands a transdisciplinary scientific perspective that brings together Geography, Artificial Intelligence, and Cognitive Science. Keywords: artificial intelligence; cognitive systems; human-computer interaction; geographic information systems; spatio-temporal dynamics; computational models of narrative; geospatial analysis; geospatial modelling; ontology; qualitative spatial modelling and reasoning; spatial assistance systems
Predicting Situated Behaviour Using Sequences of Abstract Spatial Relations
Young, Jay (The University of Birmingham) | Hawes, Nick (The University of Birmingham)
The ability to understand behaviour is a crucial skill for Artificial Intelligence systems that are expected to interact with external agents such as humans or other AI systems. Such systems might be expected to operate in co-operative or team-based scenarios, such as domestic robots capable of helping out with household jobs, or disaster relief robots expected to collaborate and lend assistance to others. Conversely, they may also be required to hinder the activities of malicious agents in adversarial scenarios. In this paper we address the problem of modelling agent behaviour in domains expressed in continuous, quantitative space by applying qualitative, relational spatial abstraction techniques. We employ three common techniques for Qualitative Spatial Reasoning — the Region Connection Calculus, the Qualitative Trajectory Calculus and the Star calculus. We then supply an algorithm based on analysis of Mutual Information that allows us to find the set of abstract, spatial relationships that provide high degrees of information about an agent's future behaviour. We employ the RoboCup soccer simulator as a base for movement-based tasks of our own design and compare the predictions of our system against those of systems utilising solely metric representations. Results show that use of a spatial abstraction-based representation, along with feature selection mechanisms, allows us to outperform metric representations on the same tasks.
Reinforcement Learning for Spatial Reasoning in Strategy Games
Leece, Michael A. (University of California, Santa Cruz) | Jhala, Arnav (University of California, Santa Cruz)
One of the major weaknesses of current real-time strategy (RTS) game agents is handling spatial reasoning at a high level. One challenge in developing spatial reasoning modules for RTS agents is to evaluate the ability of a given agent for this competency due to the inevitable confounding factors created by the complexity of these agents. We propose a simplified game that mimics spatial reasoning aspects of more complex games, while removing other complexities. Within this framework, we analyze the effectiveness of classical reinforcement learning for spatial management in order to build a detailed evaluative standard across a broad set of opponent strategies. We show that against a suite of opponents with fixed strategies, basic Q-learning is able to learn strategies to beat each. In addition, we demonstrate that performance against unseen strategies improves with prior training from other distinct strategies. We also test a modification of the basic algorithm to include multiple actors, to speed learning and increase scalability. Finally, we discuss the potential for knowledge transfer to more complex games with similar components.
On the Internal Topological Structure of Plane Regions
The study of topological information of spatial objects has for a long time been a focus of research in disciplines like computational geometry, spatial reasoning, cognitive science, and robotics. While the majority of these researches emphasised the topological relations between spatial objects, this work studies the internal topological structure of bounded plane regions, which could consist of multiple pieces and/or have holes and islands to any finite level. The insufficiency of simple regions (regions homeomorphic to closed disks) to cope with the variety and complexity of spatial entities and phenomena has been widely acknowledged. Another significant drawback of simple regions is that they are not closed under set operations union, intersection, and difference. This paper considers bounded semi-algebraic regions, which are closed under set operations and can closely approximate most plane regions arising in practice.
Algebraic Properties of Qualitative Spatio-Temporal Calculi
Dylla, Frank, Mossakowski, Till, Schneider, Thomas, Wolter, Diedrich
Qualitative spatial and temporal reasoning is based on so-called qualitative calculi. Algebraic properties of these calculi have several implications on reasoning algorithms. But what exactly is a qualitative calculus? And to which extent do the qualitative calculi proposed meet these demands? The literature provides various answers to the first question but only few facts about the second. In this paper we identify the minimal requirements to binary spatio-temporal calculi and we discuss the relevance of the according axioms for representation and reasoning. We also analyze existing qualitative calculi and provide a classification involving different notions of a relation algebra.
Transition Constraints: A Study on the Computational Complexity of Qualitative Change
Westphal, Matthias (University of Freiburg) | Hué, Julien (University of Freiburg) | Wölfl, Stefan (University of Freiburg) | Nebel, Bernhard (University of Freiburg)
Many formalisms discussed in the literature on qualitative spatial reasoning are designed for expressing static spatial constraints only. However, dynamic situations arise in virtually all applications of these formalisms, which makes it necessary to study variants and extensions involving change. This paper presents a study on the computational complexity of qualitative change. More precisely, we discuss the reasoning task of finding a solution to a temporal sequence of static reasoning problems where this sequence is subject to additional transition constraints. Our focus is primarily on smoothness and continuity constraints: we show how such transitions can be defined as relations and expressed within qualitative constraint formalisms. Our results demonstrate that for point-based constraint formalisms the interesting fragments become NP-completein the presence of continuity constraints, even if the satisfiability problem of its static descriptions is tractable.
Efficient Extraction and Representation of Spatial Information from Video Data
Sokeh, Hajar Sadeghi (The Australian National University) | Gould, Stephen (The Australian National University) | Renz, Jochen (The Australian National University)
Vast amounts of video data are available on the weband are being generated daily using surveillancecameras or other sources. Being able to efficientlyanalyse and process this data is essential for a numberof different applications. We want to be ableto efficiently detect activities in these videos or beable to extract and store essential information containedin these videos for future use and easy searchand access. Cohn et al. (2012) proposed a comprehensiverepresentation of spatial features that canbe efficiently extracted from video and used forthese purposes. In this paper, we present a modifiedversion of this approach that is equally efficientand allows us to extract spatial informationwith much higher accuracy than previously possible.We present efficient algorithms both for extractingand storing spatial information from video,as well as for processing this information in orderto obtain useful spatial features. We evaluate ourapproach and demonstrate that the extracted spatialinformation is considerably more accurate than thatobtained from existing approaches.