Discourse & Dialogue
Sentiment Analysis APIs Benchmark MonkeyLearn Blog
Sentiment analysis is a powerful example of how machine learning can help developers build better products with unique features. In short, sentiment analysis is the automated process of understanding if text written in a natural language (English, Spanish, etc.) is positive, neutral, or negative about a given subject. Nowadays, we have many instances where people express opinions and sentiment: tweets, comments, reviews, articles, chats, emails and more. One popular example is Twitter, where real-time opinions from millions of users are expressed constantly. Companies use sentiment analysis on Twitter to discover insights about their products and services.
Creating your first model
Our motive is to create a simple to integrate "Machine Learning" platform but yet powerful enough to provide high accuracy and low latency API. Such a system provides Data Mining, Machine Learning and Artificial Intelligence algorithms as a service. The system has ability to create training model for datasets uploaded as a training set and performs classification on similar datasets in the future using the saved models. "Sentiment analysis (also known as opinion mining) refers to the use of natural language processing, text analysis and computational linguistics to identify and extract subjective information in source materials." Download the sample "sentiment analysis" file Sentiment Analysis The first column should always be the label to be predicted.
Sentiment Analysis of 11 Million Tweets from Apple Live 2014 - Going beyond positive and negative
This blog was originally published on our Text Analysis blog, the blog post set out to analyze and visualize 11 million tweets collected around the time of and during Apple Live 2014. Apple Live probably got off to the worst start possible earlier this year. Most of us who tried to log on to watch the much-anticipated launch were first, forced to watch the live feed in Safari and second, greeted with the TV Truck Schedule Screen... To add to this Apple also made a complete mess of the audio. We were left sitting refreshing the page, waiting for the stream to start while being subjected to an audio visual nightmare, described brilliantly by this "fan" below: To simulate the #applelive experience, open up several separate YouTube vids, play them simultaneously, minimize, stare at a test pattern. At AYLIEN, we gathered 11 million tweets mentioning'Apple', 'iPhone', 'iOS', 'iPad', 'Mac', 'iPod', 'Macbook', 'iCloud', 'OS X', 'iWatch' and '#AppleLive' from the 4th of September to the 10th of September with a view of analyzing the tweets to gain insight into the voice of Apple Followers.
Ultradense Word Embeddings by Orthogonal Transformation
Rothe, Sascha, Ebert, Sebastian, Schütze, Hinrich
Embeddings are generic representations that are useful for many NLP tasks. In this paper, we introduce DENSIFIER, a method that learns an orthogonal transformation of the embedding space that focuses the information relevant for a task in an ultradense subspace of a dimensionality that is smaller by a factor of 100 than the original space. We show that ultradense embeddings generated by DENSIFIER reach state of the art on a lexicon creation task in which words are annotated with three types of lexical information - sentiment, concreteness and frequency. On the SemEval2015 10B sentiment analysis task we show that no information is lost when the ultradense subspace is used, but training is an order of magnitude more efficient due to the compactness of the ultradense space.
Sentiment-Based Topic Suggestion for Micro-Reviews
Lu, Ziyu (The University of Hong Kong) | Mamoulis, Nikos (University of Ioannina) | Pitoura, Evaggelia (University of Ioannina) | Tsaparas, Panayiotis (University of Ioannina)
Location-based social sites, such as Foursquare or Yelp, are gaining increasing popularity. These sites allow users to check in at venues and leave a short commentary in the form of a micro-review. Micro-reviews are rich in content as they offer a distilled and concise account of user experience. In this paper we consider the problem of predicting the topic of a micro-review by a user who visits a new venue. Such a prediction can help users make informed decisions, and also help venue owners personalize users’ experiences. However, topic modeling for micro-reviews is particularly difficult, due to their short and fragmented nature. We address this issue using pooling strategies, which aggregate micro-reviews at the venue or user level, and we propose novel probabilistic models based on Latent Dirichlet Allocation (LDA) for extracting the topics related to a user-venue pair. Our best topic model integrates influences from both venue inherent properties and user preferences, considering at the same the sentiment orientation of the users. Experimental results on real datasets demonstrate the superiority of this model compared to simpler models and previous work; they also show that venue-inherent properties have higher influences on the topics of micro-reviews.
Comparing Approaches for Combining Data Sampling and Feature Selection to Address Key Data Quality Issues in Tweet Sentiment Analysis
Prusa, Joseph D. (Florida Atlantic University) | Khoshgoftaar, Taghi M. (Florida Atlantic University)
When training tweet sentiment classifiers, many data quality challenges must be addressed. One potential issue is class imbalance, where most instances belong to a single majority class. This may negatively impact classifier performance as classifiers trained on imbalanced data may favor classification of new, unseen instances as belonging to the majority class. This issue is accompanied by a second challenge, high-dimesionality, since very large numbers of text based features are used to describe tweet datasets. For datasets where both of these challenges are present, we can combine feature selection and data sampling to address both highdimensionality and class imbalance. However, three potential approaches exist for combining data sampling and feature selection and it is unclear which approach is optimal. In this paper, we seek to determine if there is a best approach for combining data sampling and feature selection. We conduct tests using random undersampling with two post-sampling class ratios (50:50 and 35:65) combined with three feature rankers. Classifiers are trained with each potential combination approach using seven different learners on two datasets. We found that, overall, classifiers trained by performing feature selection followed by data sampling performed better than the other two approaches; however, the differences were only significant for the more imbalanced dataset.
Sentiment Classification Using Negation as a Proxy for Negative Sentiment
Ohana, Bruno (Dublin Institute of Technology) | Tierney, Brendan (Dublin Institute of Technology) | Delany, Sarah Jane (Dublin Institute of Technology)
We explore the relationship between negated text and negative sentiment in the task of sentiment classification. We propose a novel adjustment factor based on negation occurrences as a proxy for negative sentiment that can be applied to lexicon-based classifiers equipped with a negation detection pre-processing step. We performed an experiment on a multi-domain customer reviews dataset obtaining accuracy improvements over a baseline, and we further improved our results using out-of-domain data to calibrate the adjustment factor. We see future work possibilities in exploring negation detection refinements, and expanding the experiment to a broader spectrum of opinionated discourse, beyond that of customer reviews.
TweetGrep: Weakly Supervised Joint Retrieval and Sentiment Analysis of Topical Tweets
Guha, Satarupa (International Institute of Information Technology, Hyderabad) | Chakraborty, Tanmoy (University of Maryland, College Park) | Datta, Samik (Flipkart Internet Pvt. Ltd.) | Kumar, Mohit (Flipkart Internet Pvt. Ltd.) | Varma, Vasudeva (International Institute of Information Technology, Hyderabad)
An overwhelming amount of data is generated everyday onsocial media, encompassing a wide spectrum of topics. With almost every business decision depending on customer opinion, mining of social media data needs to be quick and easy.For a data analyst to keep up with the agility and the scale of the data, it is impossible to bank on fully supervised techniques to mine topics and their associated sentiments from social media. Motivated by this, we propose a weakly supervised approach (named, TweetGrep) that lets the data analyst easily define a topic by few keywords and adapt a generic sentiment classifier to the topic – by jointly modeling topics and sentiments using label regularization. Experiments with diverse datasets show that TweetGrep beats the state-of-the-art models for both the tasks of retrieving topical tweet sand analyzing the sentiment of the tweets (average improvement of 4.97% and 6.91% respectively in terms of area under the curve). Further, we show that TweetGrep can also be adopted in a novel task of hashtag disambiguation, which significantly outperforms the baseline methods.
Comparing Overall and Targeted Sentiments in Social Media during Crises
Vargas, Saul (University of Glasgow) | McCreadie, Richard (University of Glasgow) | Macdonald, Craig (University of Glasgow) | Ounis, Iadh (University of Glasgow)
The tracking of citizens' reactions in social media during crises has attracted an increasing level of interest in the research community. In particular, sentiment analysis over social media posts can be regarded as a particularly useful tool, enabling civil protection and law enforcement agencies to more effectively respond during this type of situation. Prior work on sentiment analysis in social media during crises has applied well-known techniques for overall sentiment detection in posts. However, we argue that sentiment analysis of the overall post might not always be suitable, as it may miss the presence of more targeted sentiments, e.g. about the people and organizations involved (which we refer to as sentiment targets). Through a crowdsourcing study, we show that there are marked differences between the overall tweet sentiment and the sentiment expressed towards the subjects mentioned in tweets related to three crises events.
iFeel 2.0: A Multilingual Benchmarking System for Sentence-Level Sentiment Analysis
Araujo, Matheus Lima Diniz (Federal University of Minas Gerais) | Diniz, João Paulo (Federal University of Minas Gerais) | Bastos, Lucas (Federal University of Minas Gerais) | Soares, Elias (Federal University of Minas Gerais) | Junior, Manoel (Federal University of Minas Gerais) | Ferreira, Miller (Federal University of Minas Gerais) | Ribeiro, Filipe (Federal University of Ouro Preto) | Benevenuto, Fabrício (Federal University of Minas Gerais)
Sentiment analysis became a hot topic, specially with the amount of opinions available in social media data. With the increasing interest in this theme, several methods have been proposed in the literature. Recent efforts have showed that there is no single method that always achieves the best prediction performance for different datasets. Additionally, novel methods have not being extensively compared with other methods and across different datasets, specially methods that are not designed to the English language. Consequently, researchers tend to accept any popular method as a valid methodology to measure sentiments, a practice that is usual in science. In this context, we propose iFeel 2.0, an online web system that implements 19 sentence-level sentiment analysis methods and allows users to easily label a dataset with all of them. iFeel aims at easing the comparison of new methods with baseline approaches and can also be helpful for those interested in using sentiment analysis, allowing them to choose an appropriate sentiment analysis method that works fine for a new dataset. We also incorporate a multiple language feature to allow methods designed for specific languages to be easily compared with a baseline approach that simply translates the input data to English and run these 19 methods. We hope this system can represent an important contribution to this field. Sentiment analysis became a hot topic, specially with the amount of opinions available in social media data.With the increasing interest in this theme, several methods have been proposed in the literature. Recent effortshave showed that there is no single method that always achieves the best prediction performance for different datasets. Additionally, novel methods have not being extensively compared with other methods and across different datasets, specially methods that are not designed to the English language.Consequently, researchers tend to accept any popular method as a valid methodology to measure sentiments, a practice that is usual in science.In this context, we propose iFeel 2.0, an online web system that implements 19 sentence-level sentiment analysis methods and allows users to easily label a dataset with all of them. iFeel aims at easing the comparison of new methods with baseline approaches and can also be helpful for those interested in using sentiment analysis, allowing them to choose an appropriate sentiment analysis method that works fine for a new dataset.We also incorporate a multiple language feature to allow methods designed for specific languages to be easily compared with a baseline approach that simply translates the input data to English and run these 19 methods. We hope this system can represent an important contribution to this field.