Goto

Collaborating Authors

 Semantic Networks


Building The LinkedIn Knowledge Graph

#artificialintelligence

A shorter version of this post first appeared on Pulse, our main publishing platform at LinkedIn. At LinkedIn, we use machine learning technology widely to optimize our products: for instance, ranking search results, advertisements, and updates in the news feed, or recommending people, jobs, articles, and learning opportunities to members. An important component of this technology stack is a knowledge graph that provides input signals to machine learning models and data insight pipelines to power LinkedIn products. This post gives an overview of how we build this knowledge graph. LinkedIn's knowledge graph is a large knowledge base built upon "entities" on LinkedIn, such as members, jobs, titles, skills, companies, geographical locations, schools, etc.


Probabilistic Knowledge Graph Construction: Compositional and Incremental Approaches

arXiv.org Machine Learning

Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (knowledge completion). In many cases, insufficient external resources in the knowledge population hinder the subsequent statistical inference. The gap between these two processes can be reduced by an incremental population approach. We propose a new probabilistic knowledge graph factorisation method that benefits from the path structure of existing knowledge (e.g. syllogism) and enables a common modelling approach to be used for both incremental population and knowledge completion tasks. More specifically, the probabilistic formulation allows us to develop an incremental population algorithm that trades off exploitation-exploration. Experiments on three benchmark datasets show that the balanced exploitation-exploration helps the incremental population, and the additional path structure helps to predict missing information in knowledge completion.


Machine Learning in LinkedIn Knowledge Graph

#artificialintelligence

LinkedIn knowledge graph is a large knowledge base built upon "entities" on LinkedIn, such as members, jobs, titles, skills, companies, geographical locations, schools, etc. These entities and the relationships among them form the ontology of the professional world and are used by LinkedIn to enhance its recommender systems, search, monetization and consumer products, business and consumer analytics. Creating a large knowledge base is a big challenge. Web sites like Wikipedia and Freebase primarily rely on direct contributions from human volunteers. Other related work such as Google's Knowledge Vault and Microsoft's Satori focuses on automatically extracting facts from the Web by leveraging the data redundancy nature of big data for constructing knowledge bases.


wizdom.ai – the world's largest research knowledge graph powered by artificial intelligence colwiz

#artificialintelligence

Two years ago, our ambitious team of data scientists, engineers and visualisation experts set out to tackle the challenging problem of interconnecting the entire universe of research. Using this incredibly powerful knowledge graph, we aimed to provide breakthrough insights about the past and present of research, and by applying predictive techniques we sought to outline the future of research at a global scale. Using big data analytics, machine learning and artificial intelligence, our team worked determinedly for two years piecing together the world's most comprehensive and continuously updating knowledge graph. Today, we are excited to introduce wizdom.ai, Our goal is to utilise this powerful research graph, representing the collective knowledge of human civilisation to answer the most fundamental questions for researchers, research institutions, publishers, funding organisations, businesses and governments – explore the extensive range of questions addressed by our team on the wizdom.ai


GloVe: Global Vectors for Word Representation

@machinelearnbot

GloVe is essentially a log-bilinear model with a weighted least-squares objective. The main intuition underlying the model is the simple observation that ratios of word-word co-occurrence probabilities have the potential for encoding some form of meaning. For example, consider the co-occurrence probabilities for target words ice and steam with various probe words from the vocabulary. As one might expect, ice co-occurs more frequently with solid than it does with gas, whereas steam co-occurs more frequently with gas than it does with solid. Both words co-occur with their shared property water frequently, and both co-occur with the unrelated word fashion infrequently.


The Complete Guide to Google's Knowledge Graph

#artificialintelligence

SEO is a constant source of anxiety among business owners and marketers; especially in recent years, as Google has introduced and increased its focus on "contextual" search. The Knowledge Graph is one of the best examples, because it presents a tremendous opportunity for quicker and more detailed viewer engagement--but only if you know how it works and how to get yourself listed. With the above in mind, in this article we'll go over what the Knowledge Graph is, why it should matter to you, and how to best optimize your website for inclusion. The Knowledge Graph is a knowledge base used by Google. It was created in 2012 by Google so that it could better understand the world the way people do by using entity-based searches.


Wikipedia Knowledge Graph with DeepDive

AAAI Conferences

Despite the tremendous amount of information on Wikipedia, only a very small amount is structured. Most of the information is embedded in unstructured text and extracting it is a non trivial challenge. In this paper, we propose a full pipeline built on top of DeepDive to successfully extract meaningful relations from the Wikipedia text corpus. We evaluated the system by extracting company-founders and family relations from the text. As a result, we extracted more than 140,000 distinct relations with an average precision above 90%.


A Minimalistic Approach to Sum-Product Network Learning for Real Applications

arXiv.org Machine Learning

Sum-Product Networks (SPNs) are a class of expressive yet tractable hierarchical graphical models. LearnSPN is a structure learning algorithm for SPNs that uses hierarchical co-clustering to simultaneously identifying similar entities and similar features. The original LearnSPN algorithm assumes that all the variables are discrete and there is no missing data. We introduce a practical, simplified version of LearnSPN, MiniSPN, that runs faster and can handle missing data and heterogeneous features common in real applications. We demonstrate the performance of MiniSPN on standard benchmark datasets and on two datasets from Google's Knowledge Graph exhibiting high missingness rates and a mix of discrete and continuous features.


Knowledge Graph Embedding by Flexible Translation

AAAI Conferences

Knowledge graph embedding refers to projecting entities and relations in knowledge graph into continuous vector spaces. Current state-of-the-art models are translation-based model, which build embeddings by treating relation as translation from head entity to tail entity. However, previous models is too strict to model the complex and diverse entities and relations(e.g. symmetric/transitive/one-to-many/many-to-many relations). To address these issues, we propose a new principle to allow flexible translation between entity and relation vectors. We can design a novel score function to favor flexible translation for each translation-based models without increasing model complexity. To evaluate the proposed principle, we incorporate it into previous method and conduct triple classification on benchmark datasets. Experimental results show that the principle can remarkably improve the performance compared with several state-of-the-art baselines.


All-in Text: Learning Document, Label, and Word Representations Jointly

AAAI Conferences

Conventional multi-label classification algorithms treat the target labels of the classification task as mere symbols that are void of an inherent semantics. However, in many cases textual descriptions of these labels are available or can be easily constructed from public document sources such as Wikipedia. In this paper, we investigate an approach for embedding documents and labels into a joint space while sharing word representations between documents and labels. For finding such embeddings, we rely on the text of documents as well as descriptions for the labels. The use of such label descriptions not only lets us expect an increased performance on conventional multi-label text classification tasks, but can also be used to make predictions for labels that have not been seen during the training phase. The potential of our method is demonstrated on the multi-label classification task of assigning keywords from the Medical Subject Headings (MeSH) to publications in biomedical research, both in a conventional and in a zero-shot learning setting.