Information Extraction
Sentiment Classification Using Negation as a Proxy for Negative Sentiment
Ohana, Bruno (Dublin Institute of Technology) | Tierney, Brendan (Dublin Institute of Technology) | Delany, Sarah Jane (Dublin Institute of Technology)
We explore the relationship between negated text and negative sentiment in the task of sentiment classification. We propose a novel adjustment factor based on negation occurrences as a proxy for negative sentiment that can be applied to lexicon-based classifiers equipped with a negation detection pre-processing step. We performed an experiment on a multi-domain customer reviews dataset obtaining accuracy improvements over a baseline, and we further improved our results using out-of-domain data to calibrate the adjustment factor. We see future work possibilities in exploring negation detection refinements, and expanding the experiment to a broader spectrum of opinionated discourse, beyond that of customer reviews.
Ultradense Word Embeddings by Orthogonal Transformation
Rothe, Sascha, Ebert, Sebastian, Schütze, Hinrich
Embeddings are generic representations that are useful for many NLP tasks. In this paper, we introduce DENSIFIER, a method that learns an orthogonal transformation of the embedding space that focuses the information relevant for a task in an ultradense subspace of a dimensionality that is smaller by a factor of 100 than the original space. We show that ultradense embeddings generated by DENSIFIER reach state of the art on a lexicon creation task in which words are annotated with three types of lexical information - sentiment, concreteness and frequency. On the SemEval2015 10B sentiment analysis task we show that no information is lost when the ultradense subspace is used, but training is an order of magnitude more efficient due to the compactness of the ultradense space.
Necessity of Feature Selection when Augmenting Tweet Sentiment Feature Spaces with Emoticons
Prusa, Joseph D. (Florida Atlantic University) | Khoshgoftaar, Taghi M. (Florida Atlantic University) | Napolitano, Amri (Florida Atlantic University)
Tweet sentiment classification seeks to identify the emotional polarity of a tweet. One potential way to enhance classification performance is to include emoticons as features. Emoticons are representations of faces expressing various emotions in text. They are created through combinations of letters, punctuation marks and symbols, and are frequently found within tweets. While emoticons have been used as features for sentiment classification, the importance of their inclusion has not been directly measured. In this work, we seek to determine if the addition of emoticon features improves classifier performance. We also investigate how high dimensionality impacts the addition of emoticon features. We conducted experiments testing the impact of using emoticon features, both with and without feature selection. Classifiers are trained using four different learners and either emoticons, unigrams, or both as features. Feature selection was conducted using five filter based feature rankers with four feature subset sizes. Our results showed that the choice of feature set (emoticon, unigram or both) had no significant impact in our initial tests when using no feature selection; however, with any of the tested feature selection techniques, augmenting unigram features with emoticon features resulted in significantly better performance than unigrams alone. Additionally, we investigate how the addition of emoticons changes the top features selected by the rankers.
Comparing Approaches for Combining Data Sampling and Feature Selection to Address Key Data Quality Issues in Tweet Sentiment Analysis
Prusa, Joseph D. (Florida Atlantic University) | Khoshgoftaar, Taghi M. (Florida Atlantic University)
When training tweet sentiment classifiers, many data quality challenges must be addressed. One potential issue is class imbalance, where most instances belong to a single majority class. This may negatively impact classifier performance as classifiers trained on imbalanced data may favor classification of new, unseen instances as belonging to the majority class. This issue is accompanied by a second challenge, high-dimesionality, since very large numbers of text based features are used to describe tweet datasets. For datasets where both of these challenges are present, we can combine feature selection and data sampling to address both highdimensionality and class imbalance. However, three potential approaches exist for combining data sampling and feature selection and it is unclear which approach is optimal. In this paper, we seek to determine if there is a best approach for combining data sampling and feature selection. We conduct tests using random undersampling with two post-sampling class ratios (50:50 and 35:65) combined with three feature rankers. Classifiers are trained with each potential combination approach using seven different learners on two datasets. We found that, overall, classifiers trained by performing feature selection followed by data sampling performed better than the other two approaches; however, the differences were only significant for the more imbalanced dataset.
iFeel 2.0: A Multilingual Benchmarking System for Sentence-Level Sentiment Analysis
Araujo, Matheus Lima Diniz (Federal University of Minas Gerais) | Diniz, João Paulo (Federal University of Minas Gerais) | Bastos, Lucas (Federal University of Minas Gerais) | Soares, Elias (Federal University of Minas Gerais) | Junior, Manoel (Federal University of Minas Gerais) | Ferreira, Miller (Federal University of Minas Gerais) | Ribeiro, Filipe (Federal University of Ouro Preto) | Benevenuto, Fabrício (Federal University of Minas Gerais)
Sentiment analysis became a hot topic, specially with the amount of opinions available in social media data. With the increasing interest in this theme, several methods have been proposed in the literature. Recent efforts have showed that there is no single method that always achieves the best prediction performance for different datasets. Additionally, novel methods have not being extensively compared with other methods and across different datasets, specially methods that are not designed to the English language. Consequently, researchers tend to accept any popular method as a valid methodology to measure sentiments, a practice that is usual in science. In this context, we propose iFeel 2.0, an online web system that implements 19 sentence-level sentiment analysis methods and allows users to easily label a dataset with all of them. iFeel aims at easing the comparison of new methods with baseline approaches and can also be helpful for those interested in using sentiment analysis, allowing them to choose an appropriate sentiment analysis method that works fine for a new dataset. We also incorporate a multiple language feature to allow methods designed for specific languages to be easily compared with a baseline approach that simply translates the input data to English and run these 19 methods. We hope this system can represent an important contribution to this field. Sentiment analysis became a hot topic, specially with the amount of opinions available in social media data.With the increasing interest in this theme, several methods have been proposed in the literature. Recent effortshave showed that there is no single method that always achieves the best prediction performance for different datasets. Additionally, novel methods have not being extensively compared with other methods and across different datasets, specially methods that are not designed to the English language.Consequently, researchers tend to accept any popular method as a valid methodology to measure sentiments, a practice that is usual in science.In this context, we propose iFeel 2.0, an online web system that implements 19 sentence-level sentiment analysis methods and allows users to easily label a dataset with all of them. iFeel aims at easing the comparison of new methods with baseline approaches and can also be helpful for those interested in using sentiment analysis, allowing them to choose an appropriate sentiment analysis method that works fine for a new dataset.We also incorporate a multiple language feature to allow methods designed for specific languages to be easily compared with a baseline approach that simply translates the input data to English and run these 19 methods. We hope this system can represent an important contribution to this field.
Comparing Overall and Targeted Sentiments in Social Media during Crises
Vargas, Saul (University of Glasgow) | McCreadie, Richard (University of Glasgow) | Macdonald, Craig (University of Glasgow) | Ounis, Iadh (University of Glasgow)
The tracking of citizens' reactions in social media during crises has attracted an increasing level of interest in the research community. In particular, sentiment analysis over social media posts can be regarded as a particularly useful tool, enabling civil protection and law enforcement agencies to more effectively respond during this type of situation. Prior work on sentiment analysis in social media during crises has applied well-known techniques for overall sentiment detection in posts. However, we argue that sentiment analysis of the overall post might not always be suitable, as it may miss the presence of more targeted sentiments, e.g. about the people and organizations involved (which we refer to as sentiment targets). Through a crowdsourcing study, we show that there are marked differences between the overall tweet sentiment and the sentiment expressed towards the subjects mentioned in tweets related to three crises events.
Measuring Social Jetlag in Twitter Data
Scheffler, Tatjana (University of Potsdam) | Kyba, Christopher CM (Deutsches GeoForschungsZentrum GFZ)
Social constraints have replaced the natural cycle of light and darkness as the main determinant of wake-up and activity times for many people. In this paper we show how Twitter activity can be used as a source of large-scale, naturally occurring data for the study of circadian rhythm in humans. Our year-long initial study is based on almost 1.5 million observations by over 200,000 users. The progression of the onset of Twitter activity times on free days in the course of the year is consistent with previous survey-based research on wake times. We show that the difference in wake-up time (implicating lack of sleep) on weekdays compared to Sundays is between 1 hour and over 2 hours depending on the time of year. The data also supports the assertion that Daylight Saving Time greatly disrupts the easing of social jetlag in the Spring transition.
Fusing Audio, Textual, and Visual Features for Sentiment Analysis of News Videos
Pereira, Moisés Henrique Ramos (University Center of Belo Horizonte (UNI-BH).) | Pádua, Flávio Luis Cardeal (Federal Center for Technological Education of Minas Gerais (CEFET-MG)) | Pereira, Adriano César Machado (Federal University of Minas Gerais (UFMG)) | Benevenuto, Fabrício (Federal University of Minas Gerais (UFMG)) | Dalip, Daniel Hasan (University Center of Belo Horizonte (UNI-BH))
This paper presents a novel approach to perform sentiment analysis of news videos, based on the fusion of audio, textual and visual clues extracted from their contents. The proposed approach aims at contributing to the semiodiscoursive study regarding the construction of the ethos (identity) of this media universe, which has become a central part of the modern-day lives of millions of people. To achieve this goal, we apply state-of-the-art computational methods for (1) automatic emotion recognition from facial expressions, (2) extraction of modulations in the participants' speeches and (3) sentiment analysis from the closed caption associated to the videos of interest. More specifically, we compute features, such as, visual intensities of recognized emotions, field sizes of participants, voicing probability, sound loudness, speech fundamental frequencies and the sentiment scores (polarities) from text sentences in the closed caption. Experimental results with a dataset containing 520 annotated news videos from three Brazilian and one American popular TV newscasts show that our approach achieves an accuracy of up to 84% in the sentiments (tension levels) classification task, thus demonstrating its high potential to be used by media analysts in several applications, especially, in the journalistic domain.
Tweets and Votes: A Four-Country Comparison of Volumetric and Sentiment Analysis Approaches
Ahmed, Saifuddin (University of California, Davis) | Jaidka, Kokil (Adobe Research) | Skoric, Marko M (City University of Hong Kong)
This study analyzes different methodological approaches followed in social media literature and their accuracy in predicting the general elections of four countries. Volumetric and unsupervised and supervised sentiment approaches are adopted for generating 12 metrics to compute predicted voteshares. The findings suggest that Twitter-based predictions can produce accurate results for elections, given the digital environment of a country. A cross-country analyses helps to evaluate the quality of predictions and the influence of different contexts, such as technological development and democratic setups. We recommend future scholars to combine volume, sentiment and network aspects of social media to model voting intentions in developing societies.
TweetGrep: Weakly Supervised Joint Retrieval and Sentiment Analysis of Topical Tweets
Guha, Satarupa (International Institute of Information Technology, Hyderabad) | Chakraborty, Tanmoy (University of Maryland, College Park) | Datta, Samik (Flipkart Internet Pvt. Ltd.) | Kumar, Mohit (Flipkart Internet Pvt. Ltd.) | Varma, Vasudeva (International Institute of Information Technology, Hyderabad)
An overwhelming amount of data is generated everyday onsocial media, encompassing a wide spectrum of topics. With almost every business decision depending on customer opinion, mining of social media data needs to be quick and easy.For a data analyst to keep up with the agility and the scale of the data, it is impossible to bank on fully supervised techniques to mine topics and their associated sentiments from social media. Motivated by this, we propose a weakly supervised approach (named, TweetGrep) that lets the data analyst easily define a topic by few keywords and adapt a generic sentiment classifier to the topic – by jointly modeling topics and sentiments using label regularization. Experiments with diverse datasets show that TweetGrep beats the state-of-the-art models for both the tasks of retrieving topical tweet sand analyzing the sentiment of the tweets (average improvement of 4.97% and 6.91% respectively in terms of area under the curve). Further, we show that TweetGrep can also be adopted in a novel task of hashtag disambiguation, which significantly outperforms the baseline methods.