Goto

Collaborating Authors

 Discourse & Dialogue


The importance of social media sentiment analysis (and how to conduct it)

#artificialintelligence

Today's marketers are rightfully obsessed with metrics. But don't forget that your customers are more than just data points. And yeah, it's easy to overlook our customers' feelings and emotions, which can be difficult to quantify. However, consider that emotions are the number one factor in making purchasing decisions. With so many consumers sharing their thoughts and feelings on social media, it quite literally pays for brands to have a pulse on how their products make people feel.



Dialog State Tracking with Reinforced Data Augmentation

arXiv.org Artificial Intelligence

Neural dialog state trackers are generally limited due to the lack of quantity and diversity of annotated training data. In this paper, we address this difficulty by proposing a reinforcement learning (RL) based framework for data augmentation that can generate high-quality data to improve the neural state tracker. Specifically, we introduce a novel contextual bandit generator to learn fine-grained augmentation policies that can generate new effective instances by choosing suitable replacements for the specific context. Moreover, by alternately learning between the generator and the state tracker, we can keep refining the generative policies to generate more high-quality training data for neural state tracker. Experimental results on the WoZ and MultiWoZ (restaurant) datasets demonstrate that the proposed framework significantly improves the performance over the state-of-the-art models, especially with limited training data.


Domain-Independent turn-level Dialogue Quality Evaluation via User Satisfaction Estimation

arXiv.org Artificial Intelligence

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate user satisfaction use limited feature sets and rely on annotation schemes with low inter-rater reliability, limiting generalizability to conversations spanning multiple domains. To address these gaps, we created a new Response Quality annotation scheme, based on which we developed turn-level User Satisfaction metric. We introduced five new domain-independent feature sets and experimented with six machine learning models to estimate the new satisfaction metric. Using Response Quality annotation scheme, across randomly sampled single and multi-turn conversations from 26 domains, we achieved high inter-annotator agreement (Spearman's rho 0.94). The Response Quality labels were highly correlated (0.76) with explicit turn-level user ratings. Gradient boosting regression achieved best correlation of ~0.79 between predicted and annotated user satisfaction labels. Multi Layer Perceptron and Gradient Boosting regression models generalized to an unseen domain better (linear correlation 0.67) than other models. Finally, our ablation study verified that our novel features significantly improved model performance.


Are You for Real? Detecting Identity Fraud via Dialogue Interactions

arXiv.org Artificial Intelligence

Identity fraud detection is of great importance in many real-world scenarios such as the financial industry. However, few studies addressed this problem before. In this paper, we focus on identity fraud detection in loan applications and propose to solve this problem with a novel interactive dialogue system which consists of two modules. One is the knowledge graph (KG) constructor organizing the personal information for each loan applicant. The other is structured dialogue management that can dynamically generate a series of questions based on the personal KG to ask the applicants and determine their identity states. We also present a heuristic user simulator based on problem analysis to evaluate our method. Experiments have shown that the trainable dialogue system can effectively detect fraudsters, and achieve higher recognition accuracy compared with rule-based systems. Furthermore, our learned dialogue strategies are interpretable and flexible, which can help promote real-world applications.


Sentiment Analysis In ASP.NET Core Using ML.Net

#artificialintelligence

After ML.NET Model Builder installation open your Visual Studio (in my case I'm using VS2019) After Project has been selected, enter your Project Name. Select Asp.Net Core template which you want to use, I'm using Web Application MVC. After the project has been created, we will start to build our model. Right-click on Project Add Machine Learning, ML.NET Model Builder tool GUI has been opened. After scenario selection, we will select the data set that will be used to train our model.


A Survey of Cross-lingual Word Embedding Models

Journal of Artificial Intelligence Research

Cross-lingual representations of words enable us to reason about word meaning in multilingual contexts and are a key facilitator of cross-lingual transfer when developing natural language processing models for low-resource languages. In this survey, we provide a comprehensive typology of cross-lingual word embedding models. We compare their data requirements and objective functions. The recurring theme of the survey is that many of the models presented in the literature optimize for the same objectives, and that seemingly different models are often equivalent, modulo optimization strategies, hyper-parameters, and such. We also discuss the different ways cross-lingual word embeddings are evaluated, as well as future challenges and research horizons.


Sentiment Analysis is difficult, but AI may have an answer.

#artificialintelligence

Sentiment analysis is not an easy task to perform. Text data often comes pre-loaded with a lot of noise. Sarcasm is one such type of noise innately present in social media and product reviews which may interfere with the results. Sarcastic texts demonstrate a unique behaviour. Unlike a simple negation, a sarcastic sentence conveys a negative sentiment using only positive connotation of words.


Flexibly-Structured Model for Task-Oriented Dialogues

arXiv.org Artificial Intelligence

This paper proposes a novel end-to-end architecture for task-oriented dialogue systems. It is based on a simple and practical yet very effective sequence-to-sequence approach, where language understanding and state tracking tasks are modeled jointly with a structured copy-augmented sequential decoder and a multi-label decoder for each slot. The policy engine and language generation tasks are modeled jointly following that. The copy-augmented sequential decoder deals with new or unknown values in the conversation, while the multi-label decoder combined with the sequential decoder ensures the explicit assignment of values to slots. On the generation part, slot binary classifiers are used to improve performance. This architecture is scalable to real-world scenarios and is shown through an empirical evaluation to achieve state-of-the-art performance on both the Cambridge Restaurant dataset and the Stanford in-car assistant dataset\footnote{The code is available at \url{https://github.com/uber-research/FSDM}}


Contrastive Reasons Detection and Clustering from Online Polarized Debate

arXiv.org Artificial Intelligence

This work tackles the problem of unsupervised modeling and extraction of the main contrastive sentential reasons conv eyed by divergent viewpoints on polarized issues. It proposes a pipeline approach centered around the detection and clustering of phrases, assim ilated to argument facets using a novel Phrase Author Interaction Topic -Viewpoint model. The evaluation is based on the informativeness, the r elevance and the clustering accuracy of extracted reasons. The pipel ine approach shows a significant improvement over state-of-the-art meth ods in contrastive summarization on online debate datasets.