Information Extraction
Weakly Supervised Induction of Affective Events by Optimizing Semantic Consistency
Ding, Haibo (University of Utah) | Riloff, Ellen (University of Utah)
To understand narrative text, we must comprehend how people are affected by the events that they experience. For example, readers understand that graduating from college is a positive event (achievement) but being fired from one's job is a negative event (problem). NLP researchers have developed effective tools for recognizing explicit sentiments, but affective events are more difficult to recognize because the polarity is often implicit and can depend on both a predicate and its arguments. Our research investigates the prevalence of affective events in a personal story corpus, and introduces a weakly supervised method for large scale induction of affective events. We present an iterative learning framework that constructs a graph with nodes representing events and initializes their affective polarities with sentiment analysis tools as weak supervision. The events are then linked based on three types of semantic relations: (1) semantic similarity, (2) semantic opposition, and (3) shared components. The learning algorithm iteratively refines the polarity values by optimizing semantic consistency across all events in the graph. Our model learns over 100,000 affective events and identifies their polarities more accurately than other methods.
Learning Latent Opinions for Aspect-level Sentiment Classification
Wang, Bailin (University of Massachusetts Amherst) | Lu, Wei (Singapore University of Technology and Design)
Aspect-level sentiment classification aims at detecting the sentiment expressed towards a particular target in a sentence. Based on the observation that the sentiment polarity is often related to specific spans in the given sentence, it is possible to make use of such information for better classification. On the other hand, such information can also serve as justifications associated with the predictions.We propose a segmentation attention based LSTM model which can effectively capture the structural dependencies between the target and the sentiment expressions with a linear-chain conditional random field (CRF) layer. The model simulates human's process of inferring sentiment information when reading: when given a target, humans tend to search for surrounding relevant text spans in the sentence before making an informed decision on the underlying sentiment information.We perform sentiment classification tasks on publicly available datasets on online reviews across different languages from SemEval tasks and social comments from Twitter. Extensive experiments show that our model achieves the state-of-the-art performance while extracting interpretable sentiment expressions.
Learning Sentiment-Specific Word Embedding via Global Sentiment Representation
Fu, Peng (Institute of Information Engineering, Chinese Academic of Sciences) | Lin, Zheng (Institute of Information Engineering, Chinese Academic of Sciences) | Yuan, Fengcheng (Institute of Information Engineering, Chinese Academic of Sciences) | Wang, Weiping (Institute of Information Engineering, Chinese Academic of Sciences) | Meng, Dan (Institute of Information Engineering, Chinese Academic of Sciences)
Context-based word embedding learning approaches can model rich semantic and syntactic information. However, it is problematic for sentiment analysis because the words with similar contexts but opposite sentiment polarities, such as good and bad, are mapped into close word vectors in the embedding space. Recently, some sentiment embedding learning methods have been proposed, but most of them are designed to work well on sentence-level texts. Directly applying those models to document-level texts often leads to unsatisfied results. To address this issue, we present a sentiment-specific word embedding learning architecture that utilizes local context informationas well as global sentiment representation. The architecture is applicable for both sentence-level and document-level texts. We take global sentiment representation as a simple average of word embeddings in the text, and use a corruption strategy as a sentiment-dependent regularization. Extensive experiments conducted on several benchmark datasets demonstrate that the proposed architecture outperforms the state-of-the-art methods for sentiment classification.
SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings
Cambria, Erik (Nanyang Technological University) | Poria, Soujanya (Nanyang Technological University) | Hazarika, Devamanyu (National University of Singapore) | Kwok, Kenneth (Institute of High Performance Computing, A*STAR)
With the recent development of deep learning, research in AI has gained new vigor and prominence. While machine learning has succeeded in revitalizing many research fields, such as computer vision, speech recognition, and medical diagnosis, we are yet to witness impressive progress in natural language understanding. One of the reasons behind this unmatched expectation is that, while a bottom-up approach is feasible for pattern recognition, reasoning and understanding often require a top-down approach. In this work, we couple sub-symbolic and symbolic AI to automatically discover conceptual primitives from text and link them to commonsense concepts and named entities in a new three-level knowledge representation for sentiment analysis. In particular, we employ recurrent neural networks to infer primitives by lexical substitution and use them for grounding common and commonsense knowledge by means of multi-dimensional scaling.
Sentiment Analysis via Deep Hybrid Textual-Crowd Learning Model
Dizaji, Kamran Ghasedi (University of Pittsburgh) | Huang, Heng (University of Pittsburgh)
Crowdsourcing technique provides an efficient platform to employ human skills in sentiment analysis, which is a difficult task for automatic language models due to the large variations in context, writing style, view point and so on. However, the standard crowdsourcing aggregation models are incompetent when the number of crowd labels per worker is not sufficient to train parameters, or when it is not feasible to collect labels for each sample in a large dataset. In this paper, we propose a novel hybrid model to exploit both crowd and text data for sentiment analysis, consisting of a generative crowdsourcing aggregation model and a deep sentimental autoencoder. Combination of these two sub-models is obtained based on a probabilistic framework rather than a heuristic way. We introduce a unified objective function to incorporate the objectives of both sub-models, and derive an efficient optimization algorithm to jointly solve the corresponding problem. Experimental results indicate that our model achieves superior results in comparison with the state-of-the-art models, especially when the crowd labels are scarce.
LinkedIn Data Reveals the Most Promising Jobs and In-Demand Skills of 2018
As we enter 2018 it's become clear that the jobs landscape in the United States is changing. How people are thinking about their careers and how they define success is changing. The rise of technology across every industry has created a flurry of new jobs and associated skills (and these aren't necessarily all tech roles). While we all may take a different approach to reach our own definition of success, we've compiled a list of the most promising jobs and in-demand skills, plus a few stand-out trends, to help you get there. You don't need to be technical to be successful.
Mining Public Opinion about Economic Issues: Twitter and the U.S. Presidential Election
Karami, Amir, Bennett, London S., He, Xiaoyun
Opinion polls have been the bridge between public opinion and politicians in elections. However, developing surveys to disclose people's feedback with respect to economic issues is limited, expensive, and time-consuming. In recent years, social media such as Twitter has enabled people to share their opinions regarding elections. Social media has provided a platform for collecting a large amount of social media data. This paper proposes a computational public opinion mining approach to explore the discussion of economic issues in social media during an election. Current related studies use text mining methods independently for election analysis and election prediction; this research combines two text mining methods: sentiment analysis and topic modeling. The proposed approach has effectively been deployed on millions of tweets to analyze economic concerns of people during the 2012 US presidential election.
SocialSent: Domain-Specific Sentiment Lexicons
The word soft may evoke positive connotations of warmth and cuddliness in many contexts, but calling a hockey player soft would be an insult. If you were to say something was terrific in the 1800s, this would probably imply that it was terrifying and awe-inspiring; today, terrific basically just implies that something is (pretty) good. A word's sentiment or connotation depends on the domain or context in which it is used. However, previous computational work in natural language processing largely ignores this issue, and focuses and building and deploying generic domain-general sentiment lexicons. SocialSent is a collection of code and datasets for performing domain-specific sentiment analysis.
7 LinkedIn Data Points That Will Help You Recruit Software Engineers in the U.S.
If you are recruiting software engineers in the US and feel like you are in a crazy competitive field, well, you are right. Looking at LinkedIn data, software engineers are one of the most sought-after talent pools, with the average engineer receiving 3X as much recruiter interest on LinkedIn as the average member. They're also 13% less likely to apply for a job compared to everyone else. However, the good news is that software engineers are quite open to new opportunities and they are willing to hear you out. There are millions of them on LinkedIn in the US and they're 12% more likely to respond to a recruiter about a new job opportunity, compared to the average professional. In fact, about ¼ of these engineers changed jobs in the past two years, often taking considerable pay bumps when they moved to a new organization.
Deep Learning for Sentiment Analysis : A Survey
Zhang, Lei, Wang, Shuai, Liu, Bing
Deep learning has emerged as a powerful machine learning technique that learns multiple layers of representations or features of the data and produces state-of-the-art prediction results. Along with the success of deep learning in many other application domains, deep learning is also popularly used in sentiment analysis in recent years. This paper first gives an overview of deep learning and then provides a comprehensive survey of its current applications in sentiment analysis.