Goto

Collaborating Authors

 Spatial Reasoning


voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data

arXiv.org Artificial Intelligence

Relationships in scientific data, such as the numerical and spatial distribution relations of features in univariate data, the scalar-value combinations' relations in multivariate data, and the association of volumes in time-varying and ensemble data, are intricate and complex. This paper presents voxel2vec, a novel unsupervised representation learning model, which is used to learn distributed representations of scalar values/scalar-value combinations in a low-dimensional vector space. Its basic assumption is that if two scalar values/scalar-value combinations have similar contexts, they usually have high similarity in terms of features. By representing scalar values/scalar-value combinations as symbols, voxel2vec learns the similarity between them in the context of spatial distribution and then allows us to explore the overall association between volumes by transfer prediction. We demonstrate the usefulness and effectiveness of voxel2vec by comparing it with the isosurface similarity map of univariate data and applying the learned distributed representations to feature classification for multivariate data and to association analysis for time-varying and ensemble data.


Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow Forecasting

arXiv.org Artificial Intelligence

Traffic flow forecasting on graphs has real-world applications in many fields, such as transportation system and computer networks. Traffic forecasting can be highly challenging due to complex spatial-temporal correlations and non-linear traffic patterns. Existing works mostly model such spatial-temporal dependencies by considering spatial correlations and temporal correlations separately and fail to model the direct spatial-temporal correlations. Inspired by the recent success of transformers in the graph domain, in this paper, we propose to directly model the cross-spatial-temporal correlations on the spatial-temporal graph using local multi-head self-attentions. To reduce the time complexity, we set the attention receptive field to the spatially neighboring nodes, and we also introduce an adaptive graph to capture the hidden spatial-temporal dependencies. Based on these attention mechanisms, we propose a novel Adaptive Graph Spatial-Temporal Transformer Network (ASTTN), which stacks multiple spatial-temporal attention layers to apply self-attention on the input graph, followed by linear layers for predictions. Experimental results on public traffic network datasets, METR-LA PEMS-BAY, PeMSD4, and PeMSD7, demonstrate the superior performance of our model.


IKEA launches AI-powered design experience (no Swedish meatballs included)

#artificialintelligence

We are excited to bring Transform 2022 back in-person July 19 and virtually July 20 - 28. Join AI and data leaders for insightful talks and exciting networking opportunities. For IKEA, the latest in digital transformation is all about home design driven by artificial intelligence (AI) โ€“ minus the home furnishing and decor retailer's famous Swedish meatballs. Today, it launched IKEA Kreativ, a design experience meant to bridge the ecommerce and in-store customer journeys, powered by the latest AI developments in spatial computing, machine learning and 3D mixed reality technologies. Available in-app and online, IKEA Kreativ's core technology was developed by Geomagical Labs, an IKEA retail company, which Ingka Group (the holding company that controls 367 stores of 422 IKEA stores) acquired in April 2020. IKEA Kreativ is the next step in IKEA's long journey towards digital transformation.


Google places an engineer on leave after claiming its AI is sentient

#artificialintelligence

Blake Lemoine, a Google engineer working in its Responsible AI division, revealed to The Washington Post that he believes one of the company's AI projects has achieved sentience. And after reading his conversations with LaMDA (short for Language Model for Dialogue Applications), it's easy to see why. The chatbot system, which relies on Google's language models and trillions of words from the internet, seems to have the ability to think about its own existence and its place in the world. Here's one choice excerpt from his extended chat transcript: Lemoine: So let's start with the basics. Do you have feelings and emotions?


Google places an engineer on leave after claiming its AI is sentient

Engadget

Blake Lemoine, a Google engineer working in its Responsible AI division, revealed to The Washington Post that he believes one of the company's AI projects has achieved sentience. And after reading his conversations with LaMDA (short for Language Model for Dialogue Applications), it's easy to see why. The chatbot system, which relies on Google's language models and trillions of words from the internet, seems to have the ability to think about its own existence and its place in the world. Here's one choice excerpt from his extended chat transcript: Lemoine: So let's start with the basics. Do you have feelings and emotions?


Graph Representation Learning in Biomedicine

arXiv.org Artificial Intelligence

Networks (or graphs) are pervasive in biology and medicine, from molecular interaction maps to populationscale social and health interactions. With the multitude of bioentities and associations that can be described by networks, they are prevailing representations of biological organization and biomedical knowledge. For instance, edges in a regulatory network can indicate causal activating and inhibitory relationships between genes [149]; edges between genes and diseases can indicate genes that are'upregulated by', 'downregulated by', or'associated with' a disease [141]; and edges in a knowledge network built from electronic health records (EHR) can indicate co-occurrences of medical codes across patients [81, 156, 161]. The ability to model all biomedical discoveries to date--even overlay patient-specific information--in a unified data representation has driven the development of artificial intelligence, specifically deep learning, for networks. In fact, the diversity and multimodality in networks not only boost performance of predictive models, but importantly enable broad generalization to settings not seen during training [74] and improve model interpretability [31, 140]. Nevertheless, interactions in networks give rise to a bewildering degree of complexity that can likely only be fully understood through a holistic and integrated view [14, 22, 137]. As a result, systems biology and medicine-- upon which deep learning on graphs is founded--have identified over the last two decades organizing principles that govern networks [13, 66, 85, 227]. 1


Geo-spatial Information Science: Remote sensing and machine learning in advancing carbon neutrality

#artificialintelligence

Huanfeng Shen, Wuhan University ([email protected]), Jane Liu, University of Toronto ([email protected]), Wenping Yuan, Sun Yat-Sen University ([email protected]), Yongguang Zhang, Nanjing University ([email protected]), Holly Croft, University of Sheffield ([email protected]), Xiaobin Guan, Wuhan University ([email protected]). The dramatic increase in anthropogenic carbon emissions over the last five decades has already led to substantial damage to our environment, including increases in extreme weatherevents, loss of biodiversity, and a rise in sea level. Carbon neutrality, i.e., net-zero anthropogenic carbon emissions, is necessary to ensure the sustainable future of human beings, and hundreds of countries have pledged to achieve this goal by mid-century. Remote sensing techniques can acquire frequent observations of the Earth with various temporal and spatial resolutions, and provide substantial information for carbon emission monitoring and carbon cycle modeling. Remote sensing observations not only can be directly applied to retrieve the atmospheric concentrations of greenhouse gases (e.g., CO2, CO, CH4, CFCs, O3, et al.), but also can be employed to investigate the carbon budget of natural ecosystems.


Terrain Analysis in StarCraft 1 and 2 as Combinatorial Optimization

arXiv.org Artificial Intelligence

Terrain analysis in Real-Time Strategy games is a necessary step to allow spacial reasoning. The goal of terrain analysis is to gather and process data about the map topology and properties to have a qualitative spatial representation. On StarCraft games, all previous works on terrain analysis propose a crisp analysis based on connected component detection, Voronoi diagram computation and pruning, and region merging. Those methods have been implemented as game-specific libraries, and they can only offer the same kind of analysis for all maps and all users. In this paper, we propose a way to consider terrain analysis as a combinatorial optimization problem. Our method allows different kinds of analysis by changing constraints or the objective function in the problem model. We also present a library, Taunt, implementing our method and able to handle both StarCraft 1 and StarCraft 2 maps. This makes our library a universal tool for StarCraft bots with different spatial representation needs. We believe our library unlocks the possibility to have real adaptive AIs playing StarCraft, and can be the starting point of a new wave of bots.


Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Prediction

arXiv.org Artificial Intelligence

Crime has become a major concern in many cities, which calls for the rising demand for timely predicting citywide crime occurrence. Accurate crime prediction results are vital for the beforehand decision-making of government to alleviate the increasing concern about the public safety. While many efforts have been devoted to proposing various spatial-temporal forecasting techniques to explore dependence across locations and time periods, most of them follow a supervised learning manner, which limits their spatial-temporal representation ability on sparse crime data. Inspired by the recent success in self-supervised learning, this work proposes a Spatial-Temporal Hypergraph Self-Supervised Learning framework (ST-HSL) to tackle the label scarcity issue in crime prediction. Specifically, we propose the cross-region hypergraph structure learning to encode region-wise crime dependency under the entire urban space. Furthermore, we design the dual-stage self-supervised learning paradigm, to not only jointly capture local- and global-level spatial-temporal crime patterns, but also supplement the sparse crime representation by augmenting region self-discrimination. We perform extensive experiments on two real-life crime datasets. Evaluation results show that our ST-HSL significantly outperforms state-of-the-art baselines. Further analysis provides insights into the superiority of our ST-HSL method in the representation of spatial-temporal crime patterns. The implementation code is available at https://github.com/LZH-YS1998/STHSL.


Targeting occupant feedback using digital twins: Adaptive spatial-temporal thermal preference sampling to optimize personal comfort models

arXiv.org Artificial Intelligence

Collecting intensive longitudinal thermal preference data from building occupants is emerging as an innovative means of characterizing the performance of buildings and the people who use them. These techniques have occupants giving subjective feedback using smartphones or smartwatches frequently over the course of days or weeks. The intention is that the data will be collected with high spatial and temporal diversity to best characterize a building and the occupant's preferences. But in reality, leaving the occupant to respond in an ad-hoc or fixed interval way creates unneeded survey fatigue and redundant data. This paper outlines a scenario-based (virtual experiment) method for optimizing data sampling using a smartwatch to achieve comparable accuracy in a personal thermal preference model with fewer data. This method uses BIM-extracted spatial data and Graph Neural Network-based (GNN) modeling to find regions of similar comfort preference to identify the best scenarios for triggering the occupant to give feedback. This method is compared to two baseline scenarios that use conventional zoning and a generic 4x4 square meter grid method from two field-based data sets. The results show that the proposed Build2Vec method has an 18-23\% higher overall sampling quality than the spaces-based and square-grid-based sampling methods. The Build2Vec method also performs similar to the baselines when removing redundant occupant feedback points but with better scalability potential.