Discourse & Dialogue
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis
Yang, Linyi, Li, Jiazheng, Cunningham, Pádraig, Zhang, Yue, Smyth, Barry, Dong, Ruihai
While state-of-the-art NLP models have been achieving the excellent performance of a wide range of tasks in recent years, important questions are being raised about their robustness and their underlying sensitivity to systematic biases that may exist in their training and test data. Such issues come to be manifest in performance problems when faced with out-of-distribution data in the field. One recent solution has been to use counterfactually augmented datasets in order to reduce any reliance on spurious patterns that may exist in the original data. Producing high-quality augmented data can be costly and time-consuming as it usually needs to involve human feedback and crowdsourcing efforts. In this work, we propose an alternative by describing and evaluating an approach to automatically generating counterfactual data for data augmentation and explanation. A comprehensive evaluation on several different datasets and using a variety of state-of-the-art benchmarks demonstrate how our approach can achieve significant improvements in model performance when compared to models training on the original data and even when compared to models trained with the benefit of human-generated augmented data.
Using Sentiment Analysis to Attain and Retain Customers
Matt Canada has a background in graphic design, customer service and management. Sentiment analysis will indicate ways to build a better marketing campaign for your brand. In this article, we will look into four ways to leverage sentiment analysis tools to enhance your brand presence and excite customers. Sentiment analysis is a method to analyze emotions and reactions expressed through online communication - verbal or written. Also termed as'opinion mining' or'emotion AI', sentiment analysis executes data mining, fetches results, and skims out public opinion from within content pieces to help brands get informed of their customer experience.
Over a decade of social opinion mining: a systematic review
Social media popularity and importance is on the increase due to people using it for various types of social interaction across multiple channels. This systematic review focuses on the evolving research area of Social Opinion Mining, tasked with the identification of multiple opinion dimensions, such as subjectivity, sentiment polarity, emotion, affect, sarcasm and irony, from user-generated content represented across multiple social media platforms and in various media formats, like text, image, video and audio. Through Social Opinion Mining, natural language can be understood in terms of the different opinion dimensions, as expressed by humans. This contributes towards the evolution of Artificial Intelligence which in turn helps the advancement of several real-world use cases, such as customer service and decision making. A thorough systematic review was carried out on Social Opinion Mining research which totals 485 published studies and spans a period of twelve years between 2007 and 2018.
Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification
Geng, Binzong, Yang, Min, Yuan, Fajie, Wang, Shupeng, Ao, Xiang, Xu, Ruifeng
Lifelong learning capabilities are crucial for sentiment classifiers to process continuous streams of opinioned information on the Web. However, performing lifelong learning is non-trivial for deep neural networks as continually training of incrementally available information inevitably results in catastrophic forgetting or interference. In this paper, we propose a novel iterative network pruning with uncertainty regularization method for lifelong sentiment classification (IPRLS), which leverages the principles of network pruning and weight regularization. By performing network pruning with uncertainty regularization in an iterative manner, IPRLS can adapta single BERT model to work with continuously arriving data from multiple domains while avoiding catastrophic forgetting and interference. Specifically, we leverage an iterative pruning method to remove redundant parameters in large deep networks so that the freed-up space can then be employed to learn new tasks, tackling the catastrophic forgetting problem. Instead of keeping the old-tasks fixed when learning new tasks, we also use an uncertainty regularization based on the Bayesian online learning framework to constrain the update of old tasks weights in BERT, which enables positive backward transfer, i.e. learning new tasks improves performance on past tasks while protecting old knowledge from being lost. In addition, we propose a task-specific low-dimensional residual function in parallel to each layer of BERT, which makes IPRLS less prone to losing the knowledge saved in the base BERT network when learning a new task. Extensive experiments on 16 popular review corpora demonstrate that the proposed IPRLS method sig-nificantly outperforms the strong baselines for lifelong sentiment classification. For reproducibility, we submit the code and data at:https://github.com/siat-nlp/IPRLS.
Add Machine Learning to Your Apps using TensorFlow.js
All around us, developers now leverage machine learning capabilities in their applications to amplify human effort. Tensorflow enables developers to make mind blowing capabilities like tracking your pose with a web cam, object detection using images, sentiment analysis in text, and computer generated art/music. In this session, we'll explore the opportunities for web developers to create "plug and play" machine learning experiences using TensorFlow.JS and related JavaScript libraries. We'll explore ways that you can make an impact using pre-trained models from tfhub.dev. To learn more, check out https://www.tensorflow.org/js/ .
David Horton on LinkedIn: ElligencIA Teaser
The annual production of data follows an exponential curve, the assimilation by a person or even by a group of persons of this data is no longer possible. To get the most out of it, it is necessary to be helped by computers. But as this data is mostly unstructured, classical algorithms are unable to do this job. Only Artificial Intelligence and in particular NLP with Sentiment Analysis can do it. We created ElligencIA with the aim of giving meaning to this ocean of data and taking advantage of this collective intelligence. ElligencIA, operational since January 1st 2021, is an AI consulting and solutions company for the BFSI.
Sentiment Analysis
Sentiment Analysis, as the name suggests, it means to identify the view or emotion behind a situation. It basically means to analyze and find the emotion or intent behind a piece of text or speech or any mode of communication. In this article, we will focus on the sentiment analysis of text data. We, humans, communicate with each other in a variety of languages, and any language is just a mediator or a way in which we try to express ourselves. And, whatever we say has a sentiment associated with it.
DialogSum: A Real-Life Scenario Dialogue Summarization Dataset
Chen, Yulong, Liu, Yang, Chen, Liang, Zhang, Yue
Proposal of large-scale datasets has facilitated research on deep neural models for news summarization. Deep learning can also be potentially useful for spoken dialogue summarization, which can benefit a range of real-life scenarios including customer service management and medication tracking. To this end, we propose DialogSum, a large-scale labeled dialogue summarization dataset. We conduct empirical analysis on DialogSum using state-of-the-art neural summarizers. Experimental results show unique challenges in dialogue summarization, such as spoken terms, special discourse structures, coreferences and ellipsis, pragmatics and social common sense, which require specific representation learning technologies to better deal with.
Natural Language Processing With Transformers in Python
Transformer models are the de-facto standard in modern NLP. They have proven themselves as the most expressive, powerful models for language by a large margin, beating all major language-based benchmarks time and time again. In this course, we learn all you need to know to get started with building cutting-edge performance NLP applications using transformer models like Google AI's BERT, or Facebook AI's DPR. Throughout each of these use-cases we work through a variety of examples to ensure that what, how, and why transformers are so important. Alongside these sections we also work through two full-size NLP projects, one for sentiment analysis of financial Reddit data, and another covering a fully-fledged open domain question-answering application.
Deep Context- and Relation-Aware Learning for Aspect-based Sentiment Analysis
Oh, Shinhyeok, Lee, Dongyub, Whang, Taesun, Park, IlNam, Seo, Gaeun, Kim, EungGyun, Kim, Harksoo
Existing works for aspect-based sentiment analysis (ABSA) have adopted a unified approach, which allows the interactive relations among subtasks. However, we observe that these methods tend to predict polarities based on the literal meaning of aspect and opinion terms and mainly consider relations implicitly among subtasks at the word level. In addition, identifying multiple aspect-opinion pairs with their polarities is much more challenging. Therefore, a comprehensive understanding of contextual information w.r.t. the aspect and opinion are further required in ABSA. In this paper, we propose Deep Contextualized Relation-Aware Network (DCRAN), which allows interactive relations among subtasks with deep contextual information based on two modules (i.e., Aspect and Opinion Propagation and Explicit Self-Supervised Strategies). Especially, we design novel self-supervised strategies for ABSA, which have strengths in dealing with multiple aspects. Experimental results show that DCRAN significantly outperforms previous state-of-the-art methods by large margins on three widely used benchmarks.