quaternion knowledge graph embedding
Quaternion Knowledge Graph Embeddings
In this work, we move beyond the traditional complex-valued representations, introducing more expressive hypercomplex representations to model entities and relations for knowledge graph embeddings. More specifically, quaternion embeddings, hypercomplex-valued embeddings with three imaginary components, are utilized to represent entities. Relations are modelled as rotations in the quaternion space. The advantages of the proposed approach are: (1) Latent inter-dependencies (between all components) are aptly captured with Hamilton product, encouraging a more compact interaction between entities and relations; (2) Quaternions enable expressive rotation in four-dimensional space and have more degree of freedom than rotation in complex plane; (3) The proposed framework is a generalization of ComplEx on hypercomplex space while offering better geometrical interpretations, concurrently satisfying the key desiderata of relational representation learning (i.e., modeling symmetry, anti-symmetry and inversion). Experimental results demonstrate that our method achieves state-of-the-art performance on four well-established knowledge graph completion benchmarks.
Reviews: Quaternion Knowledge Graph Embeddings
That addressed my 3rd concern to some extent (although it seems like your model requires many more epochs compared to ComplEx and I wonder how ComplEx will perform given the same number of epochs and using uniform negative sampling, but this is not a major concern). I'm not yet convinced about the issue I raised regarding relation normalization though. "We also found that the relation normalization can improve the ComplEx model as well. But it is till worse than QuatE." Why not provide some actual numbers similar to the other cases so we can see how much better QuatE is compared to ComplEx when they both use relation normalization?
Reviews: Quaternion Knowledge Graph Embeddings
The paper attempts learn better entity and relation embeddings for knowledge graphs. In this regard, the authors employ quarternion algebra with Hamilton product, which is used as the scoring function for knowledge triplets. Hamilton product is asymmetric, which is claimed to be beneficial for modeling directed egdes in a knowledge graph. Further the paper outperforms many well established methods and the authors seem to have done an exhaustive set of experiments. However, all the reviewers are in consensus that motivation for the use of quarternions is not clear, e.g. the paper does a poor job in demonstrating how does more degrees of freedom in rotation help in learning better embedding.
Quaternion Knowledge Graph Embeddings
In this work, we move beyond the traditional complex-valued representations, introducing more expressive hypercomplex representations to model entities and relations for knowledge graph embeddings. More specifically, quaternion embeddings, hypercomplex-valued embeddings with three imaginary components, are utilized to represent entities. Relations are modelled as rotations in the quaternion space. The advantages of the proposed approach are: (1) Latent inter-dependencies (between all components) are aptly captured with Hamilton product, encouraging a more compact interaction between entities and relations; (2) Quaternions enable expressive rotation in four-dimensional space and have more degree of freedom than rotation in complex plane; (3) The proposed framework is a generalization of ComplEx on hypercomplex space while offering better geometrical interpretations, concurrently satisfying the key desiderata of relational representation learning (i.e., modeling symmetry, anti-symmetry and inversion). Experimental results demonstrate that our method achieves state-of-the-art performance on four well-established knowledge graph completion benchmarks.
Quaternion Knowledge Graph Embeddings
ZHANG, SHUAI, Tay, Yi, Yao, Lina, Liu, Qi
In this work, we move beyond the traditional complex-valued representations, introducing more expressive hypercomplex representations to model entities and relations for knowledge graph embeddings. More specifically, quaternion embeddings, hypercomplex-valued embeddings with three imaginary components, are utilized to represent entities. Relations are modelled as rotations in the quaternion space. The advantages of the proposed approach are: (1) Latent inter-dependencies (between all components) are aptly captured with Hamilton product, encouraging a more compact interaction between entities and relations; (2) Quaternions enable expressive rotation in four-dimensional space and have more degree of freedom than rotation in complex plane; (3) The proposed framework is a generalization of ComplEx on hypercomplex space while offering better geometrical interpretations, concurrently satisfying the key desiderata of relational representation learning (i.e., modeling symmetry, anti-symmetry and inversion). Experimental results demonstrate that our method achieves state-of-the-art performance on four well-established knowledge graph completion benchmarks.