Discourse & Dialogue
Brooklyn Nine-Nine Meets Data Science
This job [Data Scientist] is eating me alive. I spent all these years trying to be the good guy, the man in the white hat. I'm not becoming like them… I am them -- Jake Peralta, Pilot I recently binge-watched a show on Netflix called Brooklyn Nine-Nine and I really enjoyed it. As I eagerly await the release of the next season, I thought it'd be fun to perform exploratory data analysis and sentiment analysis on the pilot episode. I found the script online and extracted the text into CSV file format.
Simultaneous Identification of Tweet Purpose and Position
Iyer, Rahul Radhakrishnan, Pei, Yulong, Sycara, Katia
Tweet classification has attracted considerable attention recently. Most of the existing work on tweet classification focuses on topic classification, which classifies tweets into several predefined categories, and sentiment classification, which classifies tweets into positive, negative and neutral. Since tweets are different from conventional text in that they generally are of limited length and contain informal, irregular or new words, so it is difficult to determine user intention to publish a tweet and user attitude towards certain topic. In this paper, we aim to simultaneously classify tweet purpose, i.e., the intention for user to publish a tweet, and position, i.e., supporting, opposing or being neutral to a given topic. By transforming this problem to a multi-label classification problem, a multi-label classification method with post-processing is proposed. Experiments on real-world data sets demonstrate the effectiveness of this method and the results outperform the individual classification methods.
MALA: Cross-Domain Dialogue Generation with Action Learning
Huang, Xinting, Qi, Jianzhong, Sun, Yu, Zhang, Rui
Response generation for task-oriented dialogues involves two basic components: dialogue planning and surface realization. These two components, however, have a discrepancy in their objectives, i.e., task completion and language quality. To deal with such discrepancy, conditioned response generation has been introduced where the generation process is factorized into action decision and language generation via explicit action representations. To obtain action representations, recent studies learn latent actions in an unsupervised manner based on the utterance lexical similarity. Such an action learning approach is prone to diversities of language surfaces, which may impinge task completion and language quality. To address this issue, we propose multistage adaptive latent action learning (MALA) that learns semantic latent actions by distinguishing the effects of utterances on dialogue progress. We model the utterance effect using the transition of dialogue states caused by the utterance and develop a semantic similarity measurement that estimates whether utterances have similar effects. For learning semantic actions on domains without dialogue states, MALA extends the semantic similarity measurement across domains progressively, i.e., from aligning shared actions to learning domain-specific actions. Experiments using multi-domain datasets, SMD and MultiWOZ, show that our proposed model achieves consistent improvements over the baselines models in terms of both task completion and language quality. 1 Introduction Task-oriented dialogue systems complete tasks for users, such as making a restaurant reservation or scheduling a meeting, in a multi-turn conversation (Gao, Galley, and Li 2018; Sun et al. 2016; Sun et al. 2017).
A Heterogeneous Graphical Model to Understand User-Level Sentiments in Social Media
Iyer, Rahul Radhakrishnan, Chen, Jing, Sun, Haonan, Xu, Keyang
Social Media has seen a tremendous growth in the last decade and is continuing to grow at a rapid pace. With such adoption, it is increasingly becoming a rich source of data for opinion mining and sentiment analysis. The detection and analysis of sentiment in social media is thus a valuable topic and attracts a lot of research efforts. Most of the earlier efforts focus on supervised learning approaches to solve this problem, which require expensive human annotations and therefore limits their practical use. In our work, we propose a semi-supervised approach to predict user-level sentiments for specific topics. We define and utilize a heterogeneous graph built from the social networks of the users with the knowledge that connected users in social networks typically share similar sentiments. Compared with the previous works, we have several novelties: (1) we incorporate the influences/authoritativeness of the users into the model, 2) we include comment-based and like-based user-user links to the graph, 3) we superimpose multiple heterogeneous graphs into one thereby allowing multiple types of links to exist between two users.
How AI is Making Sentiment Analysis Easy
It's a far more complex way of analyzing how consumers feel about our products and services, using not just simple words but longer sentence fragments. Yes, AI is becoming smart enough to understand the tone of a statement, rather than simply understanding whether certain words within a group of text have a positive or negative connotation. This is incredibly impactful for companies seeking to optimize their message, improve customer engagement, or even identify top influencers in their customer base. The possibilities of sentiment analysis are incredibly far-reaching. The types of information that AI can gather from both unstructured data and affective computing in sentiment analysis are huge.
Semantic Similarity To Improve Question Understanding in a Virtual Patient
Laleye, Fréjus A. A., Blanié, Antonia, Brouquet, Antoine, Behnamou, Dan, de Chalendar, Gaël
Abstract--In medicine, a communicating virtual patient or doctor allows students to train in medical diagnosis and dev elop skills to conduct a medical consultation. In this paper, we describe a conversational virtual standardized patient sy stem to allow medical students to simulate a diagnosis strategy o f an abdominal surgical emergency. We exploited the semantic properties captured by distributed word representations t o search for similar questions in the virtual patient dialogue syste m. We created two dialogue systems that were evaluated on dataset s collected during tests with students. The first system based on handcrafted rules obtains 92.29% as F 1-score on the studied clinical case while the second system that combines rules an d semantic similarity achieves 94.88%. It represents an error reduction of 9.70% as compared to the rules-only-based system. The medical diagnosis practice is traditionally bedside taught. Theoretical courses are supplemented by internshi ps in hospital services. The medical student observes the practi ce of doctors and interns and practices himself under their contr ol. This type of learning has the disadvantage to confront immediately the medical student with complex situations withou t practical training (technical and human) beforehand.
Model Deployment for Data Scientists Using TensorFlow: Part 1 - Nightfall AI
In the world of machine learning, model deployment is a crucial piece of the puzzle. While data scientists excel at other parts of the pipeline, deploying machine learning models tends to fall under the umbrella of software engineering or IT operations. And for good reason--successful deployments require a myriad of complex tasks, including building infrastructure, implementing APIs, load balancing, and integrating with data pipelines. We'll briefly walk you through a basic model deployment example by picking out tools and planning out an approach to construct a simple sentiment classification model. By the end of this post you will have the tools to serve your deep learning (DL) models via an API.
Event Outcome Prediction using Sentiment Analysis and Crowd Wisdom in Microblog Feeds
Iyer, Rahul Radhakrishnan, Zheng, Ronghuo, Li, Yuezhang, Sycara, Katia
--Sentiment Analysis of microblog feeds has attracted considerable interest in recent times. Most of the current work focuses on tweet sentiment classification. But not much work has been done to explore how reliable the opinions of the mass (crowd wisdom) in social network microblogs such as twitter are in predicting outcomes of certain events such as election debates. In this work, we investigate whether crowd wisdom is useful in predicting such outcomes and whether their opinions are influenced by the experts in the field. We work in the domain of multi-label classification to perform sentiment classification of tweets and obtain the opinion of the crowd. This learnt sentiment is then used to predict outcomes of events such as: US Presidential Debate winners, Grammy A ward winners, Super Bowl Winners. We find that in most of the cases, the wisdom of the crowd does indeed match with that of the experts, and in cases where they don't (particularly in the case of debates), we see that the crowd's opinion is actually influenced by that of the experts. I NTRODUCTION Over the past few years, microblogs have become one of the most popular online social networks. Microblogging websites have evolved to become a source of varied kinds of information. This is due to the nature of microblogs: people post real-time messages about their opinions and express sentiment on a variety of topics, discuss current issues, complain, etc. Twitter is one such popular microblogging service where users create status messages (called "tweets"). With over 400 million tweets per day on Twitter, microblog users generate large amount of data, which cover very rich topics ranging from politics, sports to celebrity gossip. Because the user generated content on microblogs covers rich topics and expresses sentiment/opinions of the mass, mining and analyzing this information can prove to be very beneficial both to the industrial and the academic community. Tweet classification has attracted considerable attention because it has become very important to analyze peoples' sentiments and opinions over social networks.