Colombo Big Data Meetup August 2nd 2018 Let's analyze the world's reaction to road traffic 2. In a nutshell Social Developer Skills & Interests Recognitions 7 years experience Full stack developer Angular, Big Data enthusiast Automation fanboy Microsoft MVP Developer Technologies Top contributor in the world on Stackoverflow for #Angular, #Cosmosdb Web application architecture Business intelligence Big Data Visualization Azure platform 120 repositories on Stackblitz 4800 answers on Stackoverflow Github contributions D3 directives and more Open-source contributions Sajeetharan Sinnathurai Senior Tech Lead at 99X Technology A few things about me! 3. What is sentiment analysis? "computationally identify and categorize the opinions expressed in a piece of text; determine whether positive/neutral/negative toward a topic/product…" [Oxford Dict.] 4. Why it is so important? What is Logic Apps? • Visual designer without writing single line of code • Dozens of pre-built templates to get started • Out of box support for popular SaaS and on-premises apps • Use with custom API apps of your own • Biztalk APIs for expert integration scenarios 9. Cognitive services Vision Speech Knowledge Language Search "Give your apps a human side" 10. •Sentiment analysis •Key phrase extraction •Topic detection •Language detection 13. Are we? Give away What were the two main Azure resources presented in this session? What is the name of the NOSQL database that could replace MSSQL in the proposed solution?

Take the example of a video streaming service like Hulu or Netflix. In order to make recommendations for users, engineers need to decide which videos to recommend based on input from users.

ABSTRACT The availability of powerful Natural Language Processing techniques led to the emergence of AI tool that reads and interprets unstructured textual information, such as news and social media messages. The sentiment of finance-related content influences trading and investment decisions of players in financial markets and hence, moves the prices of assets. Dr. Svetlana Borovkova has been working for several years in the area of sentiment analysis and its relation to financial markets; applications of sentiment analysis range from commodity trading to systemic risk to quantitative investment strategies. In this talk, Dr. Borovkova will give an overview of this exciting field and show, among other things, how media sentiment can be used to forecast global financial distress, to generate sector and country rotation investment strategies and to help enhance machine learning applications to intraday trading. SPEAKER Dr. Svetlana Borovkova is an Associate Professor of Quantitative Finance in Vrije Universiteit Amsterdam and Head of Quantitative Modelling in risk advisory firm Probability & Partners.

Facebook Inc. suspended another company that harvested data from its site and said it was investigating whether the analytics firm's contracts with the U.S. government and a Russian nonprofit tied to the Kremlin violate the platform's policies. Crimson Hexagon, based in Boston, has had contracts in recent years to analyze public Facebook data for those and other clients, according to people familiar with the matter and federal procurement data. Crimson Hexagon says it has the largest repository of public social media posts, totaling more than one trillion, from sites that also include Twitter Inc. TWTR -0.05% and Instagram. Crimson Hexagon operates with little oversight from Facebook once it pulls public data from the social-media platform, according to more than a dozen people familiar with the business. The government contracts weren't approved by Facebook in advance, for example, the people said.

Facebook said Friday it suspended a longtime partner that had used data from Facebook and other social networks to assist governments -- including Russia, Turkey, and the U.S. -- in monitoring public sentiment, a more cautious approach in the wake of a data privacy scandal. Facebook said it had found no evidence of wrongdoing by the Boston-based company, Crimson Hexagon, but it was curtailing the company's access to its data while it investigated the matter. The preemptive move represents a shift for Facebook in the wake of the controversy over political consultancy Cambridge Analytica, which Facebook said inappropriately collected the private profiles of more than 80 million Facebook users. The social network is under investigation from three different federal agencies over its work with Cambridge Analytica and, since the crisis erupted, has suspended more than 200 apps which had access to Facebook data. Crimson Hexagon, which primarily used public, aggregated data from people who made their profiles available for anyone to see, is the largest of this new wave of suspensions.

Human Factors in Hypertext (HUMAN) Opinion Mining, Summarization and Diversification Narrative and Hypertext I attended the Opinion Mining, Summarization and Diversification workshop. The workshop started with a talk titled: "On Reviews, Ratings and Collaborative Filtering," presented by Dr. Oren Sar Shalom, principal data scientist at Intuit, Israel. Next, Ophélie Fraisier, a PhD student studying stance analysis on social media at Paul Sabatier University, France, presented: "Politics on Twitter: A Panorama," in which she surveyed methods of analyzing tweets to study and detect polarization and stances, as well as election prediction and political engagement. He showed how collective opinion mining can help capture the drivers behind opinions as opposed to individual opinion mining (or sentiment) which identifies single individual attitudes toward an item. I thank a million people! https://t.co/I3quPp6nw3 He also discussed a phenomenon in which people are likely to lie to pollsters (social desirability bias) but are honest to Google ("Digital Truth Serum") because Google incentivizes telling the truth. The paper sessions followed the keynote with two full papers and a short paper presentation. Google search data as "digital truth serum" - while reporting of child abuse go down at the recession time, Google search data indicates that real child abuse increases https://t.co/DQQoAotZqB However, it feels more like a research talk rather than a #keynote. Though still interesting, I'd rather hear about a #vision for this area of #research.

British authorities looking into inappropriate use of data gathered by political consultant Cambridge Analytica from millions of Facebook users say some of the systems that accessed the material appear to be in Russia or a group of former Soviet states.

Facebook has admitted that the company gave dozens of tech companies and app developers special access to its users' data after publicly saying it had restricted outside companies to access such data back in 2015. It's an unusual clear view of how the largest social networking site manages your personal information. During the Cambridge Analytica scandal revealed March this year, Facebook stated that it already cut off third-party access to its users' data and their friends in May 2015 only. However, in a 747-page long document [PDF] delivered to Congress late Friday, the social networking giant admitted that it continued sharing data with 61 hardware and software makers, as well as app developers after 2015 as well. The disclosure comes in response to hundreds of questions posed to Facebook CEO Mark Zuckerberg by members of Congress in April about its company's practices with data of its billions of users.

Twitter has one of the biggest data sets in the world. It is much different from Facebook from the aspect that Twitter is real time. Twitter data sets are awesome troves of information and provide great insights. Working on some Twitter data set and providing valuable insights can be a good portfolio project to showcase. One can get twitter data here.

According to Forrester, the average enterprise is sitting on 100 terabytes (TB) or more of unstructured data. In order to extract actionable insights from that data and become insights-driven businesses, those enterprises must adopt best-in-class Text Analytics technology 1. Our guest speaker, Forrester's Boris Evelson, will discuss his latest report: The Forrester Wave: AI-Based Text Analytics Platforms Report Q2 2018 and review his findings and recommendations on what companies must look for when evaluating text analytics providers. Fabrice Martin, Clarabridge's Chief Product Officer will join Boris and provide examples of how companies have successfully adopted this technology in both the contact center and in traditional CEM settings as well as offer insight into the future of Clarabridge's text analytics capabilities. In this webinar, you will learn: How companies are transitioning from data-driven to insights-driven How to evaluate and select the right text analytics platform What to look for beyond the basic building blocks of sentiment and categorization 1 Source: Forrester Analytics Global Business Technographics Data And Analytics Survey, 2017.