A story of tweets and sentiments

Weeks ago my Twitter timeline was full of negative stories. My timeline was so full of negative content that I started thinking Twitter was full of hate:_( That's why I decided to get some metrics to see if my intuition was right. With the help of Mª Asunción Jiménez Cordero, a PhD student specialized in Machine Learning, we developed a Spark application written in Scala to analyze real-time tweets and classify them as negative, positive or neutral using Support Vector Machine. In this post, we'll tell you how we developed this app in order to get the results you can find at https://pedrovgs.github.io/Roma/. Let's split this post in the different challenges we faced!