Goto

Collaborating Authors

 Information Extraction


Brand Image, Sentiment Analysis and Social Media

@machinelearnbot

Analyzing sentiments is a very subjective exercise. He has his own software company which is a mid-sized software one and that which was doing fairly well and at one time, he tried to analyze the broader sentiment about the brand value of his company on the open market. The overall brand sentiment turned out to be negative and even more surprising was the fact that it leaned towards the most negative scale. This surprised him because the other parameters that his HR partners provided him were painting a contrasting picture- the attrition rate was low, the employee engagement survey produced positive results etc. Then he did a deep dive into the feedback content and realized that almost all of the comments were negative and that the people who posted feedback were all disgruntled employees and not many employees who were happy posted any kind of feedback on any social forum. They were too busy with their work and adding more value to the organization.


Sentiment Analysis with Talend & Stanford CoreNLP Datalytyx

@machinelearnbot

In my previous blog, I showed you how to integrate Stanford CoreNLP with Talend using a simple example. In this post I'll show you how to modify that code in order to make the most of Talend's strengths as a data integration tool. Below is a Talend job I have built to read some tweets from a database (see this blog article for information on how to retrieve tweets with Talend), run the text through the CoreNLP sentiment analysis code, and then write tweets back to the database with the addition of the sentiment. In this particular example, the text to be analysed are tweets coming from a database. However, the same job will work with any string input.


Text Analytics: Greater Usability Less Time to Insight

#artificialintelligence

Transparency Market Research has released a new market report titled Text Analytics Market - Global Industry Analysis, Size, Share, Growth, Trends and Forecast 2016 - 2024. According to this report, the global text analytics market revenue stood at US 2.82 bn in 2015 and is expected to reach US 12.16 bn by 2024, at a CAGR of 17.6% from 2016 to 2024. Text analytics is a method of converting unstructured data into a meaningful form for the analysis of customer feedback, product reviews, sentimental analysis, and entity modeling for supporting fact-based decision making. Several techniques of statistical, linguistic and machine learning are used in text analytics solutions for the retrieval of relevant information from unstructured data. The increasing proliferation of textual data has challenged the ability of organizations across various sectors to summarize and understand them to make better business decisions.


Mental Health Alerts via Facebook? - The Crux

#artificialintelligence

Every day, 730,000 comments and 420 billion statuses are posted on Facebook, 500 billion 140-character tweets are posted and 430,000 hours of new video is uploaded to YouTube. The Internet is a goldmine of data just waiting to be analyzed. Ever since social media crept deeper and deeper into our daily lives, governments and advertisers have been utilizing this data for myriad purposes. Now, a team of researchers at the University of Ottawa, University of Alberta and the Université de Montpellier in France is examining ways to use social media data to detect and monitor people who are potentially at risk of mental health issues. Using computer algorithms, the team will apply social web mining and "sentiment analysis methods" to troves of data generated through social media to detect at-risk individuals. Sentiment analysis is the process of identifying and categorizing opinions expressed in text through a computer program.


Integrating Stanford CoreNLP with Talend Studio Datalytyx

@machinelearnbot

In my previous blog Twitter Sentiment Analysis using Talend, I showed how to extract tweets from Twitter using Talend and then how to do some basic sentiment analysis on those tweets. In this post, I will introduce the Stanford CoreNLP toolkit and show how to integrate it with Talend to perform various NLP (Natural Language Processing) analyses including sentiment analysis. Previously I had managed to perform some basic sentiment analysis on tweets. However, I'd noticed a major flaw with my technique: the method I was using would take each word in a sentence and average the sentiment score of each word. I explain the issue in more detail in my original post, but to give you a flavour of it, I'll show you some examples of correct/incorrect sentiment identification that would result from my previous method: This is incorrect as it should be fairly obvious that this sentence carries negative sentiment.


Pride and Prejudice and Z-scores

#artificialintelligence

You might think literary criticism is no place for statistical analysis, but given digital versions of the text you can, for example, use sentiment analysis to infer the dramatic arc of an Oscar Wilde novel. Now you can apply similar techniques to the works of Jane Austen thanks to Julia Silge's R package janeaustenr (available on CRAN). The package includes the full text the 6 Austen novels, including Pride and Prejudice and Sense and Sensibility. With the novels' text in hand, Julia then applied Bing sentiment analysis (as implemented in R's syuzhet package), shown here with annotations marking the major dramatic turns in the book: There's quite a lot of noise in that chart, so Julia took the elegant step of using a low-pass fourier transform to smooth the sentiment for all six novels, which allows for a comparison of the dramatic arcs: This is super interesting to me. Emma and Northanger Abbey have the most similar plot trajectories, with their tales of immature women who come to understand their own folly and grow up a bit.


Data Science: The numbers game Law almost lost.

@machinelearnbot

On the face of it, Analytics and Law are manifestly divergent fields of practice. One need only consider the nature of Algorithms that require numerical attributes for their calculations and the textual rigidity of substantive law to realize this. The very first obstacle one will encounter in applying Analytics to Law is the absence of calculable numerical variables in raw legal data. No judicial precedent, statute or common law principle has ever been reduced to a mathematically sound numerical expression; raw legal data is simply not Analytics-receptive. There are however some methods of mining raw legal data, like powerful Text Analytics that make it possible to build reasonably accurate classification, sentiment analysis and many other models.


Text Analysis blog Aylien

#artificialintelligence

As you may be aware, we recently boosted our Text Analysis API offering with a cool new feature, Aspect-Based Sentiment Analysis. The whole idea behind Aspect-Based Sentiment Analysis (ABSA) is to provide a way for our users to extract specific aspects from a piece of text and determine the sentiment towards each aspect individually. We've built models for 4 different domains (industries). You can see the domains and the domain specific aspects listed in the image below. We explain it quickly and simply here to help get you up to speed.


Predicting Eurovision 2016 from Twitter data…

#artificialintelligence

This is 2016 version of the Eurovision prediction. I have explained systematics in quite detailed fashion in the last year post which you can find here. Very shortly, I measured how many tweets have been sent about each song from each country. From this, I estimated amount of votes that each country would give to another. For example, if Germans tweets the most about Polish song, I assume that Germany will give Poland 12 points.


Facebook Data Firms Are Being Awfully Quiet On The 'Trending Topics' Story

International Business Times

Just when you need Big Data, it's nowhere to be found. After Facebook made headlines this week for allegedly meddling with its Trending Topics section, several analytics firms that have provided International Business Times with social media data in the past declined to provide numbers related to the ruckus. The kerfuffle was kicked off by a Gizmodo report alleging the company's Trending Topics section suppresses conservative topics of interest, thanks to the whims of its curators. Within hours of the news, the U.S. Senate Committee on Commerce wrote a letter to CEO Mark Zuckerberg asking representatives of Facebook to travel to Washington for a briefing on its curation guidelines. And Thursday, Facebook released its full guidelines for news selection, showing the extent to which human judgment is part of the process.