Goto

Collaborating Authors

 Temporal Reasoning


DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion

arXiv.org Artificial Intelligence

There has recently been increasing interest in learning representations of temporal knowledge graphs (KGs), which record the dynamic relationships between entities over time. Temporal KGs often exhibit multiple simultaneous non-Euclidean structures, such as hierarchical and cyclic structures. However, existing embedding approaches for temporal KGs typically learn entity representations and their dynamic evolution in the Euclidean space, which might not capture such intrinsic structures very well. To this end, we propose Dy- ERNIE, a non-Euclidean embedding approach that learns evolving entity representations in a product of Riemannian manifolds, where the composed spaces are estimated from the sectional curvatures of underlying data. Product manifolds enable our approach to better reflect a wide variety of geometric structures on temporal KGs. Besides, to capture the evolutionary dynamics of temporal KGs, we let the entity representations evolve according to a velocity vector defined in the tangent space at each timestamp. We analyze in detail the contribution of geometric spaces to representation learning of temporal KGs and evaluate our model on temporal knowledge graph completion tasks. Extensive experiments on three real-world datasets demonstrate significantly improved performance, indicating that the dynamics of multi-relational graph data can be more properly modeled by the evolution of embeddings on Riemannian manifolds.


One-shot Learning for Temporal Knowledge Graphs

arXiv.org Artificial Intelligence

Most real-world knowledge graphs are characterized by a long-tail relation frequency distribution where a significant fraction of relations occurs only a handful of times. This observation has given rise to recent interest in low-shot learning methods that are able to generalize from only a few examples. The existing approaches, however, are tailored to static knowledge graphs and not easily generalized to temporal settings, where data scarcity poses even bigger problems, e.g., due to occurrence of new, previously unseen relations. We address this shortcoming by proposing a one-shot learning framework for link prediction in temporal knowledge graphs. Our proposed method employs a self-attention mechanism to effectively encode temporal interactions between entities, and a network to compute a similarity score between a given query and a (one-shot) example. Our experiments show that the proposed algorithm outperforms the state of the art baselines for two well-studied benchmarks while achieving significantly better performance for sparse relations.


RTFE: A Recursive Temporal Fact Embedding Framework for Temporal Knowledge Graph Completion

arXiv.org Artificial Intelligence

In recent years, many efforts have been made to complete knowledge graphs (KGs) by various graph embedding methods, most of which only focus on static KGs (SKGs) without considering the time dependency of facts. However, KGs in reality are dynamic and there exists correlations between facts with different timestamps. Due to the sparsity of temporal KGs (TKGs), SKG embedding methods cannot be directly applied to TKGs. And existing methods of TKG embedding suffer from two issues: (1) they follow the pattern of SKG embedding where all facts need to be retrained when a new timestamp appears; (2) they don't provide a general way to transplant SKG embedding methods to TKGs and therefore lack extensibility. In this paper, we propose a novel Recursive Temporal Fact Embedding Framework (RTFE) to transplant translation-based or graph neural network-based SKG embedding methods to TKGs. In the recursive way, timestamp parameters provide a good starting point for the next future timestamp. And existing SKG embedding models can be used as components. Experiments on TKGs show that our proposed framework (1) outperforms the state-of-the-art baseline model in the entity prediction task on fact datasets; (2) achieves similar performance compared with the state-of-the-art baseline model in relation prediction task on fact datasets; and (3) shows performance in the entity prediction task on event datasets.


Software Engineering Event Modeling using Relative Time in Temporal Knowledge Graphs

arXiv.org Machine Learning

We present a multi-relational temporal Knowledge Graph based on the daily interactions between artifacts in GitHub, one of the largest social coding platforms. Such representation enables posing many user-activity and project management questions as link prediction and time queries over the knowledge graph. In particular, we introduce two new datasets for i) interpolated time-conditioned link prediction and ii) extrapolated time-conditioned link/time prediction queries, each with distinguished properties. Our experiments on these datasets highlight the potential of adapting knowledge graphs to answer broad software engineering questions. Meanwhile, it also reveals the unsatisfactory performance of existing temporal models on extrapolated queries and time prediction queries in general. To overcome these shortcomings, we introduce an extension to current temporal models using relative temporal information with regards to past events.


A Survey on Temporal Reasoning for Temporal Information Extraction from Text (Extended Abstract)

arXiv.org Artificial Intelligence

Time is deeply woven into how people perceive, and communicate about the world. Almost unconsciously, we provide our language utterances with temporal cues, like verb tenses, and we can hardly produce sentences without such cues. Extracting temporal cues from text, and constructing a global temporal view about the order of described events is a major challenge of automatic natural language understanding. Temporal reasoning, the process of combining different temporal cues into a coherent temporal view, plays a central role in temporal information extraction. This article presents a comprehensive survey of the research from the past decades on temporal reasoning for automatic temporal information extraction from text, providing a case study on the integration of symbolic reasoning with machine learning-based information extraction systems.


Working Toward Planetary Scale Location Insights

#artificialintelligence

Recent innovations in agile aerospace have created unique offerings in high cadence satellite imagery. While this is of immense interest to imagery analysts, a significant portion of GIS professionals and geo-data scientists work less with raster data (AKA imagery) and more with point and vector data. Planet operates the world's largest constellation of earth observation satellites providing near-daily coverage of the entirety of Earth's landmass. Over the past couple of years, we have been working on bringing computer vision and spatiotemporal analysis to market to enable access and data transformations on this rich imagery archive. We recently announced the general availability of our analytic feeds and the launch of our building change detection analytics in private beta (sign up for info here).


Diachronic Embedding for Temporal Knowledge Graph Completion

arXiv.org Artificial Intelligence

Knowledge graphs (KGs) typically contain temporal facts indicating relationships among entities at different times. Due to their incompleteness, several approaches have been proposed to infer new facts for a KG based on the existing ones-a problem known as KG completion. KG embedding approaches have proved effective for KG completion, however, they have been developed mostly for static KGs. Developing temporal KG embedding models is an increasingly important problem. In this paper, we build novel models for temporal KG completion through equipping static models with a diachronic entity embedding function which provides the characteristics of entities at any point in time. This is in contrast to the existing temporal KG embedding approaches where only static entity features are provided. The proposed embedding function is model-agnostic and can be potentially combined with any static model. We prove that combining it with SimplE, a recent model for static KG embedding, results in a fully expressive model for temporal KG completion. Our experiments indicate the superiority of our proposal compared to existing baselines.


Time Reveals All Wounds: Modeling Temporal Characteristics of Cyberbullying

AAAI Conferences

Cyberbullying is a critical socio-technical problem that seriously limits the use of online interaction spaces by different individuals. Emerging literature identifies cyberbullying as a continuous temporal phenomena rather than one-off incidents. However, as of yet, little computational work has been done to model the temporal dynamics of cyberbullying in online sessions. In this work, we model the temporal dynamics of commenting behavior as point processes and validate it over a crowd-labeled cyberbullying data-set of Instagram media sessions. We define several temporal features to model the distinguishing characteristics between cyberbullying and regular media sessions. We find that our approach is successfully able to identify significant differences between cyberbullying and regular media sessions, and provide a performance increase in cyberbullying detection. This paves the way for more nuanced work on the use of temporal modeling to detect and mitigate the occurrence of cyberbullying.



[R] State of the art spatio-temporal analysis literature • r/MachineLearning

@machinelearnbot

These two papers have nice overview of recent works. First one explain recent architectures and introduce a state of the art method for video recognition problem and the second one analyze datasets, algorithms and evaluation metrics in a different perspective.