Semantic Networks
Is There More Pattern in Knowledge Graph? Exploring Proximity Pattern for Knowledge Graph Embedding
Li, Ren, Cao, Yanan, Zhu, Qiannan, Li, Xiaoxue, Fang, Fang
Modeling of relation pattern is the core focus of previous Knowledge Graph Embedding works, which represents how one entity is related to another semantically by some explicit relation. However, there is a more natural and intuitive relevancy among entities being always ignored, which is that how one entity is close to another semantically, without the consideration of any explicit relation. We name such semantic phenomenon in knowledge graph as proximity pattern. In this work, we explore the problem of how to define and represent proximity pattern, and how it can be utilized to help knowledge graph embedding. Firstly, we define the proximity of any two entities according to their statistically shared queries, then we construct a derived graph structure and represent the proximity pattern from global view. Moreover, with the original knowledge graph, we design a Chained couPle-GNN (CP-GNN) architecture to deeply merge the two patterns (graphs) together, which can encode a more comprehensive knowledge embedding. Being evaluated on FB15k-237 and WN18RR datasets, CP-GNN achieves state-of-the-art results for Knowledge Graph Completion task, and can especially boost the modeling capacity for complex queries that contain multiple answer entities, proving the effectiveness of introduced proximity pattern.
Knowledge Graphs: Data in Context for Responsive Businesses [New Book]
Knowledge graphs have been around for almost half a century โ as the term was first coined in 1972! For a long time, they simply languished in the academic world until Google announced their knowledge graph in 2012. Since then, knowledge graphs have evolved quite dramatically, and now there is no turning back. The last 10 years have seen a meteoric rise in machine learning (ML) and artificial intelligence (AI). Because of their ability to drive intelligence into data and add context, knowledge graphs are used to make ML and AI more reliable, robust, trustworthy, and explainable.
Identifying and Mitigating Gender Bias in Hyperbolic Word Embeddings
Kumar, Vaibhav, Bhotia, Tenzin Singhay, Kumar, Vaibhav, Chakraborty, Tanmoy
Euclidean word embedding models such as GloVe and Word2Vec have been shown to reflect human-like gender biases. In this paper, we extend the study of gender bias to the recently popularized hyperbolic word embeddings. We propose gyrocosine bias, a novel measure for quantifying gender bias in hyperbolic word representations and observe a significant presence of gender bias. To address this problem, we propose Poincar\'e Gender Debias (PGD), a novel debiasing procedure for hyperbolic word representations. Experiments on a suit of evaluation tests show that PGD effectively reduces bias while adding a minimal semantic offset.
Path Based Hierarchical Clustering on Knowledge Graphs
Pietrasik, Marcin, Reformat, Marek
Knowledge graphs have emerged as a widely adopted medium for storing relational data, making methods for automatically reasoning with them highly desirable. In this paper, we present a novel approach for inducing a hierarchy of subject clusters, building upon our earlier work done in taxonomy induction. Our method first constructs a tag hierarchy before assigning subjects to clusters on this hierarchy. We quantitatively demonstrate our method's ability to induce a coherent cluster hierarchy on three real-world datasets.
Learning through structure: towards deep neuromorphic knowledge graph embeddings
Chian, Victor Caceres, Hildebrandt, Marcel, Runkler, Thomas, Dold, Dominik
Computing latent representations for graph-structured data is an ubiquitous learning task in many industrial and academic applications ranging from molecule synthetization to social network analysis and recommender systems. Knowledge graphs are among the most popular and widely used data representations related to the Semantic Web. Next to structuring factual knowledge in a machine-readable format, knowledge graphs serve as the backbone of many artificial intelligence applications and allow the ingestion of context information into various learning algorithms. Graph neural networks attempt to encode graph structures in low-dimensional vector spaces via a message passing heuristic between neighboring nodes. Over the recent years, a multitude of different graph neural network architectures demonstrated ground-breaking performances in many learning tasks. In this work, we propose a strategy to map deep graph learning architectures for knowledge graph reasoning to neuromorphic architectures. Based on the insight that randomly initialized and untrained (i.e., frozen) graph neural networks are able to preserve local graph structures, we compose a frozen neural network with shallow knowledge graph embedding models. We experimentally show that already on conventional computing hardware, this leads to a significant speedup and memory reduction while maintaining a competitive performance level. Moreover, we extend the frozen architecture to spiking neural networks, introducing a novel, event-based and highly sparse knowledge graph embedding algorithm that is suitable for implementation in neuromorphic hardware.
A Framework for Institutional Risk Identification using Knowledge Graphs and Automated News Profiling
Mahfouz, Mahmoud, Nourbakhsh, Armineh, Shah, Sameena
Organizations around the world face an array of risks impacting their operations globally. It is imperative to have a robust risk identification process to detect and evaluate the impact of potential risks before they materialize. Given the nature of the task and the current requirements of deep subject matter expertise, most organizations utilize a heavily manual process. In our work, we develop an automated system that (a) continuously monitors global news, (b) is able to autonomously identify and characterize risks, (c) is able to determine the proximity of reaching triggers to determine the distance from the manifestation of the risk impact and (d) identifies organization's operational areas that may be most impacted by the risk. Other contributions also include: (a) a knowledge graph representation of risks and (b) relevant news matching to risks identified by the organization utilizing a neural embedding model to match the textual description of a given risk with multi-lingual news.
Towards Automatic Bias Detection in Knowledge Graphs
Keidar, Daphna, Zhong, Mian, Zhang, Ce, Shrestha, Yash Raj, Paudel, Bibek
With the recent surge in social applications relying on knowledge graphs, the need for techniques to ensure fairness in KG based methods is becoming increasingly evident. Previous works have demonstrated that KGs are prone to various social biases, and have proposed multiple methods for debiasing them. However, in such studies, the focus has been on debiasing techniques, while the relations to be debiased are specified manually by the user. As manual specification is itself susceptible to human cognitive bias, there is a need for a system capable of quantifying and exposing biases, that can support more informed decisions on what to debias. To address this gap in the literature, we describe a framework for identifying biases present in knowledge graph embeddings, based on numerical bias metrics. We illustrate the framework with three different bias measures on the task of profession prediction, and it can be flexibly extended to further bias definitions and applications. The relations flagged as biased can then be handed to decision makers for judgement upon subsequent debiasing.
Temporal Knowledge Graph Completion using Box Embeddings
Messner, Johannes, Abboud, Ralph, Ceylan, ฤฐsmail ฤฐlkan
Knowledge graph completion is the task of inferring missing facts based on existing data in a knowledge graph. Temporal knowledge graph completion (TKGC) is an extension of this task to temporal knowledge graphs, where each fact is additionally associated with a time stamp. Current approaches for TKGC primarily build on existing embedding models which are developed for (static) knowledge graph completion, and extend these models to incorporate time, where the idea is to learn latent representations for entities, relations, and timestamps and then use the learned representations to predict missing facts at various time steps. In this paper, we propose BoxTE, a box embedding model for TKGC, building on the static knowledge graph embedding model BoxE. We show that BoxTE is fully expressive, and possesses strong inductive capacity in the temporal setting. We then empirically evaluate our model and show that it achieves state-of-the-art results on several TKGC benchmarks.
Knowledge Graph-based Neurodegenerative Diseases and Diet Relationship Discovery
From the 4,300 abstracts, there were 1,188, 1,309, 822, 322, and 40 unique entities (concepts) for Disease, Chemical, Gene, Species, and SNP&Mutation, respectively. These biomedical concepts form 21,521, 8,048, 5,042, and 161 unique relationships: Disease-Chemical, Disease-Gene, Disease-species, and Disease-SNP&Mutation respectively. The most frequent Disease-Concept pairs can be seen in Table 1. We noticed that polyphenols, which are usually found in fruits and vegetables, have high co-existence with multiple neurodegenerative diseases. Polyphenols are well known for their function to reduce the risk of neurodegenerative disease [8].
AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce
Xu, Guohai, Chen, Hehong, Li, Feng-Lin, Sun, Fu, Shi, Yunzhou, Zeng, Zhixiong, Zhou, Wei, Zhao, Zhongzhou, Zhang, Ji
Live streaming is becoming an increasingly popular trend of sales in E-commerce. The core of live-streaming sales is to encourage customers to purchase in an online broadcasting room. To enable customers to better understand a product without jumping out, we propose AliMe MKG, a multi-modal knowledge graph that aims at providing a cognitive profile for products, through which customers are able to seek information about and understand a product. Based on the MKG, we build an online live assistant that highlights product search, product exhibition and question answering, allowing customers to skim over item list, view item details, and ask item-related questions. Our system has been launched online in the Taobao app, and currently serves hundreds of thousands of customers per day.