Semantic Networks
Efficient Knowledge Graph Validation via Cross-Graph Representation Learning
Wang, Yaqing, Ma, Fenglong, Gao, Jing
Recent advances in information extraction have motivated the automatic construction of huge Knowledge Graphs (KGs) by mining from large-scale text corpus. However, noisy facts are unavoidably introduced into KGs that could be caused by automatic extraction. To validate the correctness of facts (i.e., triplets) inside a KG, one possible approach is to map the triplets into vector representations by capturing the semantic meanings of facts. Although many representation learning approaches have been developed for knowledge graphs, these methods are not effective for validation. They usually assume that facts are correct, and thus may overfit noisy facts and fail to detect such facts. Towards effective KG validation, we propose to leverage an external human-curated KG as auxiliary information source to help detect the errors in a target KG. The external KG is built upon human-curated knowledge repositories and tends to have high precision. On the other hand, although the target KG built by information extraction from texts has low precision, it can cover new or domain-specific facts that are not in any human-curated repositories. To tackle this challenging task, we propose a cross-graph representation learning framework, i.e., CrossVal, which can leverage an external KG to validate the facts in the target KG efficiently. This is achieved by embedding triplets based on their semantic meanings, drawing cross-KG negative samples and estimating a confidence score for each triplet based on its degree of correctness. We evaluate the proposed framework on datasets across different domains. Experimental results show that the proposed framework achieves the best performance compared with the state-of-the-art methods on large-scale KGs.
Challenges of Linking Organizational Information in Open Government Data to Knowledge Graphs
Portisch, Jan, Fallatah, Omaima, Neumaier, Sebastian, Jaradeh, Mohamad Yaser, Polleres, Axel
Open Government Data (OGD) is being published by various public administration organizations around the globe. Within the metadata of OGD data catalogs, the publishing organizations (1) are not uniquely and unambiguously identifiable and, even worse, (2) change over time, by public administration units being merged or restructured. In order to enable fine-grained analyses or searches on Open Government Data on the level of publishing organizations, linking those from OGD portals to publicly available knowledge graphs (KGs) such as Wikidata and DBpedia seems like an obvious solution. Still, as we show in this position paper, organization linking faces significant challenges, both in terms of available (portal) metadata and KGs in terms of data quality and completeness. We herein specifically highlight five main challenges, namely regarding (1) temporal changes in organizations and in the portal metadata, (2) lack of a base ontology for describing organizational structures and changes in public knowledge graphs, (3) metadata and KG data quality, (4) multilinguality, and (5) disambiguating public sector organizations. Based on available OGD portal metadata from the Open Data Portal Watch, we provide an in-depth analysis of these issues, make suggestions for concrete starting points on how to tackle them along with a call to the community to jointly work on these open challenges.
Commonsense Knowledge Graph Reasoning by Selection or Generation? Why?
Wang, Cunxiang, Wu, Jinhang, Liu, Luxin, Zhang, Yue
Commonsense knowledge graph reasoning(CKGR) is the task of predicting a missing entity given one existing and the relation in a commonsense knowledge graph (CKG). Existing methods can be classified into two categories generation method and selection method. Each method has its own advantage. We theoretically and empirically compare the two methods, finding the selection method is more suitable than the generation method in CKGR. Given the observation, we further combine the structure of neural Text Encoder and Knowledge Graph Embedding models to solve the selection method's two problems, achieving competitive results. We provide a basic framework and baseline model for subsequent CKGR tasks by selection methods.
DensE: An Enhanced Non-Abelian Group Representation for Knowledge Graph Embedding
Capturing the composition patterns of relations is a vital task in knowledge graph completion. It also serves as a fundamental step towards multi-hop reasoning over learned knowledge. Previously, rotation-based translational methods, e.g., RotatE, have been developed to model composite relations using the product of a series of complex-valued diagonal matrices. However, RotatE makes several oversimplified assumptions on the composition patterns, forcing the relations to be commutative, independent from entities and fixed in scale. To tackle this problem, we have developed a novel knowledge graph embedding method, named DensE, to provide sufficient modeling capacity for complex composition patterns. In particular, our method decomposes each relation into an SO(3) group-based rotation operator and a scaling operator in the three dimensional (3-D) Euclidean space. The advantages of our method are twofold: (1) For composite relations, the corresponding diagonal relation matrices can be non-commutative and related with entity embeddings; (2) It extends the concept of RotatE to a more expressive setting with lower model complexity and preserves the direct geometrical interpretations, which reveals how relations with distinct patterns (i.e., symmetry/anti-symmetry, inversion and composition) are modeled. Experimental results on multiple benchmark knowledge graphs show that DensE outperforms the current state-of-the-art models for missing link prediction, especially on composite relations.
Convolutional Complex Knowledge Graph Embeddings
Demir, Caglar, Ngomo, Axel-Cyrille Ngonga
In this paper, we study the problem of learning continuous vector representations of knowledge graphs for predicting missing links. We present a new approach called ConEx, which infers missing links by leveraging the composition of a 2D convolution with a Hermitian inner product of complex-valued embedding vectors. We evaluate ConEx against state-of-the-art approaches on the WN18RR, FB15K-237, KINSHIP and UMLS benchmark datasets. Our experimental results show that ConEx achieves a performance superior to that of state-of-the-art approaches such as RotatE, QuatE and TuckER on the link prediction task on all datasets while requiring at least 8 times fewer parameters. We ensure the reproducibility of our results by providing an open-source implementation which includes the training, evaluation scripts along with pre-trained models at https://github.com/conex-kge/ConEx.
Implementing Knowledge Graphs in Enterprises - Some Tips and Trends
Don't try to put the cart before the horse: realize that efficient data preparation (and thus interoperable standards) and data quality, especially in the enterprise environment, are a basic requirement for all applications of artificial intelligence. The development of competences and experts in the field of artificial intelligence must take place at least parallel to the process of every technological decision, but not at the end of the implementation of an AI strategy. Outsourcing must not be part of this strategy. 'Not to boil the ocean', in other words: small, agile, consecutive pilot projects alone are not enough to develop an AI strategy. Parallel to the pilot phase, a more far-reaching strategy should be developed together with the management to promote cross-departmental, process-independent and data-driven decision-making and activities.
Semantic AI: Bringing Machine Learning and Knowledge Graphs Together
Hybrid Computing, and thus Hybrid Analytics are concepts which are undergoing accelerated mutations, with the introduction of Edge and Fog Computing, in the wake of new mobility and IoT communication protocols, technologies and practices being phased in the Industry on a daily basis, 5G being its latest illustration. Our objective will be to shed some light on the various impacts, both positive and challenging, that these transformations impose on Cloud Analytics. This session will first address what these changes spell out for Cloud Analytics and in particular, what are the new considerations, key assets and enabling paradigms being introduced, both in terms of functional architectures and underlying infrastructures supporting the ingestion, distributed treatment and produced insights, in the cloud, in the fog, and at the edge, along with the unlocked potentials but also the pitfalls associated to them. As a part in these considerations, the session will address the intrinsic security, information privacy and data protection concerns, and the specific hybrid specificities which allow for new ways to compartment privacy and protect anonymity while maintaining the same descriptive and predictive capabilities. Unfortunately, we'll see that these new hybrid architectures can also harbor new combinations of vulnerabilities.
Tackling scalability issues in mining path patterns from knowledge graphs: a preliminary study
Monnin, Pierre, Bresso, Emmanuel, Couceiro, Miguel, Smaรฏl-Tabbone, Malika, Napoli, Amedeo, Coulet, Adrien
Features mined from knowledge graphs are widely used within multiple knowledge discovery tasks such as classification or fact-checking. Here, we consider a given set of vertices, called seed vertices, and focus on mining their associated neighboring vertices, paths, and, more generally, path patterns that involve classes of ontologies linked with knowledge graphs. Due to the combinatorial nature and the increasing size of real-world knowledge graphs, the task of mining these patterns immediately entails scalability issues. In this paper, we address these issues by proposing a pattern mining approach that relies on a set of constraints (e.g., support or degree thresholds) and the monotonicity property. As our motivation comes from the mining of real-world knowledge graphs, we illustrate our approach with PGxLOD, a biomedical knowledge graph.
Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Framework
Ali, Mehdi, Berrendorf, Max, Hoyt, Charles Tapley, Vermue, Laurent, Galkin, Mikhail, Sharifzadeh, Sahand, Fischer, Asja, Tresp, Volker, Lehmann, Jens
The heterogeneity in recently published knowledge graph embedding models' implementations, training, and evaluation has made fair and thorough comparisons difficult. In order to assess the reproducibility of previously published results, we re-implemented and evaluated 19 interaction models in the PyKEEN software package. Here, we outline which results could be reproduced with their reported hyper-parameters, which could only be reproduced with alternate hyper-parameters, and which could not be reproduced at all as well as provide insight as to why this might be the case. We then performed a large-scale benchmarking on four datasets with several thousands of experiments and 21,246 GPU hours of computation time. We present insights gained as to best practices, best configurations for each model, and where improvements could be made over previously published best configurations. Our results highlight that the combination of model architecture, training approach, loss function, and the explicit modeling of inverse relations is crucial for a model's performances, and not only determined by the model architecture. We provide evidence that several architectures can obtain results competitive to the state-of-the-art when configured carefully. We have made all code, experimental configurations, results, and analyses that lead to our interpretations available at https://github.com/pykeen/pykeen and https://github.com/pykeen/benchmarking
PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings
Ali, Mehdi, Berrendorf, Max, Hoyt, Charles Tapley, Vermue, Laurent, Sharifzadeh, Sahand, Tresp, Volker, Lehmann, Jens
Recently, knowledge graph embeddings (KGEs) received significant attention, and several software libraries have been developed for training and evaluating KGEs. While each of them addresses specific needs, we re-designed and re-implemented PyKEEN, one of the first KGE libraries, in a community effort. PyKEEN 1.0 enables users to compose knowledge graph embedding models (KGEMs) based on a wide range of interaction models, training approaches, loss functions, and permits the explicit modeling of inverse relations. Besides, an automatic memory optimization has been realized in order to exploit the provided hardware optimally, and through the integration of Optuna extensive hyper-parameter optimization (HPO) functionalities are provided.