Spatial Reasoning
Joint Spatio-Textual Reasoning for Answering Tourism Questions
Contractor, Danish, Goel, Shashank, Mausam, null, Singla, Parag
Our goal is to answer real-world tourism questions that seek Points-of-Interest (POI) recommendations. Such questions express various kinds of spatial and non-spatial constraints, necessitating a combination of textual and spatial reasoning. In response, we develop the first joint spatio-textual reasoning model, which combines geo-spatial knowledge with information in textual corpora to answer questions. We first develop a modular spatial-reasoning network that uses geo-coordinates of location names mentioned in a question, and of candidate answer POIs, to reason over only spatial constraints. We then combine our spatial-reasoner with a textual reasoner in a joint model and present experiments on a real world POI recommendation task. We report substantial improvements over existing models with-out joint spatio-textual reasoning.
The nucleus acts as a ruler tailoring cell responses to spatial constraints
Single cells continuously experience and react to mechanical challenges in three-dimensional tissues. Spatial constraints in dense tissues, physical activity, and injury all impose changes in cell shape. How cells can measure shape deformations to ensure correct tissue development and homeostasis remains largely unknown (see the Perspective by Shen and Niethammer). Working independently, Venturini et al. and Lomakin et al. now show that the nucleus can act as an intracellular ruler to measure cellular shape variations. The nuclear envelope provides a gauge of cell deformation and activates a mechanotransduction pathway that controls actomyosin contractility and migration plasticity. The cell nucleus thereby allows cells to adapt their behavior to the local tissue microenvironment. Science , this issue p. [eaba2644][1], p. [eaba2894][2]; see also p. [295][3] ### INTRODUCTION The human body is a crowded place. This crowding is even more acute when the regulation of cell growth and proliferation fails during the formation of a tumor. Dealing with the lack of space in crowded environments presents cells with a challenge. This is especially true for immune cells, whose task is to patrol tissues, causing them to experience both acute and sustained deformation as they move. Although changes in tissue crowding and associated cell shape alterations have been known by pathologists to be key diagnostic traits of late-stage tumors since the 19th century, the impact of these changes on the biology of cancer and immune cells remains unclear. Moreover, it is not known whether cells can detect and adaptively respond to deformations in densely packed spaces. ### RATIONALE To test the hypothesis that cells possess an ability to detect and respond to environmentally induced changes in their shape, we fabricated artificial microenvironments that mimic the conditions experienced by tumor and immune cells in a crowded tissue. By combining dynamic confinement, force measurements, and live cell imaging, we were able to quantify cell responses to precisely controlled physical perturbations of their shape. ### RESULTS Our results show that, although cells are surprisingly resistant to compressive forces, they monitor their own shape and develop an active contractile response when deformed below a specific height. Notably, we find that this is achieved by cells monitoring the deformation of their largest internal compartment: the nucleus. We establish that the nucleus provides cells with a precise measure of the extent of their deformation. Once cell compression exceeds the size of the nucleus, it causes the bounding nuclear envelope (NE) to unfold and stretch. The onset of the contractile response occurs when the NE reaches a fully unfolded state. This transition in the mechanical state of the NE and its membranes permits calcium release from internal membrane stores and activates the calcium-dependent phospholipase cPLA2, an enzyme known to operate as a molecular sensor of nuclear membrane tension and a critical regulator of signaling and metabolism. Activated cPLA2 catalyzes the formation of arachidonic acid, an omega-6 fatty acid that, among other processes, potentiates the adenosine triphosphatase activity of myosin II. This induces contractility of the actomyosin cortex, which produces pushing forces to resist physical compression and to rapidly squeeze the cell out of its compressive microenvironment in an “evasion reflex” mechanism. ### CONCLUSION Although the nucleus has traditionally been considered a passive storehouse for genetic material, our work identifies it as an active compartment that rapidly convers mechanical inputs into signaling outputs, with a critical role of its envelope in this sensing function. The nucleus is able to detect environmentally imposed compression and respond to it by generating a signal that is used to change cell behaviors. This phenomenon plays a critical role in ensuring that cells, such as the immune cells within a tumor, can adapt, survive, and efficiently move through a crowded and mechanically heterogeneous microenvironment. Characterizing the full spectrum of signals triggered by nuclear compression has the potential to elucidate mechanisms underlying signaling, epigenetic, and metabolic adaptations of cells to their mechanoenvironment and is thus an exciting avenue for future research. ![Figure][4] The nuclear ruler and its contribution to the “life cycle” of a confined cell. (1) Cell confinement below resting nucleus size, leading to nuclear deformation and to unfolding, and stretching of the nuclear envelope. (2) Nuclear membrane tension increase, which triggers calcium release, cPLA2 activation, and arachidonic acid (ARA) production. (3) Actomyosin force ( F ) generation. (4) Increased cell migratory capacity and escape from confinement. The microscopic environment inside a metazoan organism is highly crowded. Whether individual cells can tailor their behavior to the limited space remains unclear. In this study, we found that cells measure the degree of spatial confinement by using their largest and stiffest organelle, the nucleus. Cell confinement below a resting nucleus size deforms the nucleus, which expands and stretches its envelope. This activates signaling to the actomyosin cortex via nuclear envelope stretch-sensitive proteins, up-regulating cell contractility. We established that the tailored contractile response constitutes a nuclear ruler–based signaling pathway involved in migratory cell behaviors. Cells rely on the nuclear ruler to modulate the motive force that enables their passage through restrictive pores in complex three-dimensional environments, a process relevant to cancer cell invasion, immune responses, and embryonic development. [1]: /lookup/doi/10.1126/science.aba2644 [2]: /lookup/doi/10.1126/science.aba2894 [3]: /lookup/doi/10.1126/science.abe3881 [4]: pending:yes
Uncertainty Aware Wildfire Management
Diao, Tina, Singla, Samriddhi, Mukhopadhyay, Ayan, Eldawy, Ahmed, Shachter, Ross, Kochenderfer, Mykel
Recent wildfires in the United States have resulted in loss of life and billions of dollars, destroying countless structures and forests. Fighting wildfires is extremely complex. It is difficult to observe the true state of fires due to smoke and risk associated with ground surveillance. There are limited resources to be deployed over a massive area and the spread of the fire is challenging to predict. This paper proposes a decision-theoretic approach to combat wildfires. We model the resource allocation problem as a partially-observable Markov decision process. We also present a data-driven model that lets us simulate how fires spread as a function of relevant covariates. A major problem in using data-driven models to combat wildfires is the lack of comprehensive data sources that relate fires with relevant covariates. We present an algorithmic approach based on large-scale raster and vector analysis that can be used to create such a dataset. Our data with over 2 million data points is the first open-source dataset that combines existing fire databases with covariates extracted from satellite imagery. Through experiments using real-world wildfire data, we demonstrate that our forecasting model can accurately model the spread of wildfires. Finally, we use simulations to demonstrate that our response strategy can significantly reduce response times compared to baseline methods.
The Cone of Silence: Speech Separation by Localization
Jenrungrot, Teerapat, Jayaram, Vivek, Seitz, Steve, Kemelmacher-Shlizerman, Ira
Given a multi-microphone recording of an unknown number of speakers talking concurrently, we simultaneously localize the sources and separate the individual speakers. At the core of our method is a deep network, in the waveform domain, which isolates sources within an angular region $\theta \pm w/2$, given an angle of interest $\theta$ and angular window size $w$. By exponentially decreasing $w$, we can perform a binary search to localize and separate all sources in logarithmic time. Our algorithm allows for an arbitrary number of potentially moving speakers at test time, including more speakers than seen during training. Experiments demonstrate state-of-the-art performance for both source separation and source localization, particularly in high levels of background noise.
DAS: Intelligent Scheduling Systems for Shipbuilding
Daewoo Shipbuilding Company, one of the largest shipbuilders in the world, has experienced great deal of trouble with the planning and scheduling of its production process. To solve the problems, from 1991 to 1993, Korea Advanced Institute of Science and Technology (KAIST) and Daewoo jointly conducted the Daewoo Shipbuilding Scheduling (das) Project. To integrate the scheduling expert systems for shipbuilding, we used a hierarchical scheduling architecture. To automate the dynamic spatial layout of objects in various areas of the shipyard, we developed spatial scheduling expert systems. For reliable estimation of person-hour requirements, we implemented the neural network-based person-hour estimator.
Qualitative Spatial Reasoning Extracting and Reasoning with Spatial Aggregates
Reasoning about spatial data is a key task in many applications, including geographic information systems, meteorological and fluid-flow analysis, computer-aided design, and protein structure databases. Such applications often require the identifi- cation and manipulation of qualitative spatial representations, for example, to detect whether one object will soon occlude another in a digital image or efficiently determine relationships between a proposed road and wetland regions in a geographic data set. Qualitative spatial reasoning (QSR) provides representational primitives (a spatial "vocabulary") and inference mechanisms for these tasks. This article first reviews representative work on QSR for data-poor scenarios, where the goal is to design representations that can answer qualitative queries without much numeric information. It then turns to the data-rich case, where the goal is to derive and manipulate qualitative spatial representations that efficiently and correctly abstract important spatial aspects of the underlying data for use in subsequent tasks.
On the Inclusion of Spatial Information for Spatio-Temporal Neural Networks
de Medrano, Rodrigo, Aznarte, José L.
When confronting a spatio-temporal regression, it is sensible to feed the model with any available prior information about the spatial dimension. For example, it is common to define the architecture of neural networks based on spatial closeness, adjacency, or correlation. A common alternative, if spatial information is not available or is too costly to introduce it in the model, is to learn it as an extra step of the model. While the use of prior spatial knowledge, given or learnt, might be beneficial, in this work we question this principle by comparing spatial agnostic neural networks with state of the art models. Our results show that the typical inclusion of prior spatial information is not really needed in most cases. In order to validate this counterintuitive result, we perform thorough experiments over ten different datasets related to sustainable mobility and air quality, substantiating our conclusions on real world problems with direct implications for public health and economy.
Analyzing the Capacity of Distributed Vector Representations to Encode Spatial Information
Mirus, Florian, Stewart, Terrence C., Conradt, Jorg
Vector Symbolic Architectures belong to a family of related cognitive modeling approaches that encode symbols and structures in high-dimensional vectors. Similar to human subjects, whose capacity to process and store information or concepts in short-term memory is subject to numerical restrictions,the capacity of information that can be encoded in such vector representations is limited and one way of modeling the numerical restrictions to cognition. In this paper, we analyze these limits regarding information capacity of distributed representations. We focus our analysis on simple superposition and more complex, structured representations involving convolutive powers to encode spatial information. In two experiments, we find upper bounds for the number of concepts that can effectively be stored in a single vector.
Community detection, pattern recognition, and hypergraph-based learning: approaches using metric geometry and persistent homology
Nguyen, Dong Quan Ngoc, Xing, Lin, Lin, Lizhen
Hypergraph data appear and are hidden in many places in the modern age. They are data structure that can be used to model many real data examples since their structures contain information about higher order relations among data points. One of the main contributions of our paper is to introduce a new topological structure to hypergraph data which bears a resemblance to a usual metric space structure. Using this new topological space structure of hypergraph data, we propose several approaches to study community detection problem, detecting persistent features arising from homological structure of hypergraph data. Also based on the topological space structure of hypergraph data introduced in our paper, we introduce a modified nearest neighbors methods which is a generalization of the classical nearest neighbors methods from machine learning. Our modified nearest neighbors methods have an advantage of being very flexible and applicable even for discrete structures as in hypergraphs. We then apply our modified nearest neighbors methods to study sign prediction problem in hypegraph data constructed using our method.
Using satellite imagery to understand and promote sustainable development
Burke, Marshall, Driscoll, Anne, Lobell, David B., Ermon, Stefano
Accurate and comprehensive measurements of a range of sustainable development outcomes are fundamental inputs into both research and policy. We synthesize the growing literature that uses satellite imagery to understand these outcomes, with a focus on approaches that combine imagery with machine learning. We quantify the paucity of ground data on key human-related outcomes and the growing abundance and resolution (spatial, temporal, and spectral) of satellite imagery. We then review recent machine learning approaches to model-building in the context of scarce and noisy training data, highlighting how this noise often leads to incorrect assessment of models' predictive performance. We quantify recent model performance across multiple sustainable development domains, discuss research and policy applications, explore constraints to future progress, and highlight key research directions for the field.