Asia
Community-Based Question Answering via Asymmetric Multi-Faceted Ranking Network Learning
Zhao, Zhou (Zhejiang University) | Lu, Hanqing (Zhejiang University) | Zheng, Vincent W. (Advanced Digital Sciences Center) | Cai, Deng (Zhejiang University) | He, Xiaofei (Zhejiang University) | Zhuang, Yueting (Zhejiang University)
Nowadays the community-based question answering (CQA) sites become the popular Internet-based web service, which have accumulated millions of questions and their posted answers over time. Thus, question answering becomes an essential problem in CQA sites, which ranks the high-quality answers to the given question. Currently, most of the existing works study the problem of question answering based on the deep semantic matching model to rank the answers based on their semantic relevance, while ignoring the authority of answerers to the given question. In this paper, we consider the problem of community-based question answering from the viewpoint of asymmetric multi-faceted ranking network embedding. We propose a novel asymmetric multi-faceted ranking network learning framework for community-based question answering by jointly exploiting the deep semantic relevance between question-answer pairs and the answerers' authority to the given question. We then develop an asymmetric ranking network learning method with deep recurrent neural networks by integrating both answers' relative quality rank to the given question and the answerers' following relations in CQA sites. The extensive experiments on a large-scale dataset from a real world CQA site show that our method achieves better performance than other state-of-the-art solutions to the problem.
Greedy Flipping for Constrained Word Deletion
Yao, Jin-ge (Peking University) | Wan, Xiaojun (Peking University)
In this paper we propose a simple yet efficient method for constrained word deletion to compress sentences, based on top-down greedy local flipping from multiple random initializations. The algorithm naturally integrates various grammatical constraints in the compression process, without using time-consuming integer linear programming solvers. Our formulation suits for any objective function involving arbitrary local score definition. Experimental results show that the proposed method achieves nearly identical performance with explicit ILP formulation while being much more efficient.
Word Embedding Based Correlation Model for Question/Answer Matching
Shen, Yikang (Beihang University) | Rong, Wenge (Beihang University) | Jiang, Nan (Beihang University) | Peng, Baolin (The Chinese University of Hong Kong) | Tang, Jie (Tsinghua University) | Xiong, Zhang (Beihang University)
The large scale of Q&A archives accumulated in community based question answering (CQA) servivces are important information and knowledge resource on the web. Question and answer matching task has been attached much importance to for its ability to reuse knowledge stored in these systems: it can be useful in enhancing user experience with recurrent questions. In this paper, a Word Embedding based Correlation (WEC) model is proposed by integrating advantages of both the translation model and word embedding. Given a random pair of words, WEC can score their co-occurrence probability in Q&A pairs, while it can also leverage the continuity and smoothness of continuous space word representation to deal with new pairs of words that are rare in the training parallel text. An experimental study on Yahoo! Answers dataset and Baidu Zhidao dataset shows this new method's promising potential.
Salience Estimation via Variational Auto-Encoders for Multi-Document Summarization
Li, Piji (The Chinese University of Hong Kong) | Wang, Zihao (The Chinese University of Hong Kong) | Lam, Wai (The Chinese University of Hong Kong) | Ren, Zhaochun (University College London) | Bing, Lidong (AI Platform Department, Tencent Inc.)
We propose a new unsupervised sentence salience framework for Multi-Document Summarization (MDS), which can be divided into two components: latent semantic modeling and salience estimation. For latent semantic modeling, a neural generative model called Variational Auto-Encoders (VAEs) is employed to describe the observed sentences and the corresponding latent semantic representations. Neural variational inference is used for the posterior inference of the latent variables. For salience estimation, we propose an unsupervised data reconstruction framework, which jointly considers the reconstruction for latent semantic space and observed term vector space. Therefore, we can capture the salience of sentences from these two different and complementary vector spaces. Thereafter, the VAEs-based latent semantic model is integrated into the sentence salience estimation component in a unified fashion, and the whole framework can be trained jointly by back-propagation via multi-task learning. Experimental results on the benchmark datasets DUC and TAC show that our framework achieves better performance than the state-of-the-art models.
Structural Correspondence Learning for Cross-Lingual Sentiment Classification with One-to-Many Mappings
Li, Nana (Hebei University of Technology) | Zhai, Shuangfei (Binghamton University) | Zhang, Zhongfei (Binghamton University) | Liu, Boying (Hebei University of Technology)
Structural correspondence learning (SCL) is an effective method for cross-lingual sentiment classification. This approach uses unlabeled documents along with a word translation oracle to automatically induce task specific, cross-lingual correspondences. It transfers knowledge through identifying important features, i.e., pivot features. For simplicity, however, it assumes that the word translation oracle maps each pivot feature in source language to exactly only one word in target language. This one-to-one mapping between words in different languages is too strict. Also the context is not considered at all. In this paper, we propose a cross-lingual SCL based on distributed representation of words; it can learn meaningful one-to-many mappings for pivot words using large amounts of monolingual data and a small dictionary. We conduct experiments on NLP&CC 2013 cross-lingual sentiment analysis dataset, employing English as source language, and Chinese as target language. Our method does not rely on the parallel corpora and the experimental results show that our approach is more competitive than the state-of-the-art methods in cross-lingual sentiment classification.
Efficiently Mining High Quality Phrases from Texts
Li, Bing (Northeastern University, Shenyang) | Yang, Xiaochun (Northeastern University, Shenyang) | Wang, Bin (Northeastern University, Shenyang) | Cui, Wei (Northeastern University, Shenyang)
Phrase mining is a key research problem for semantic analysis and text-based information retrieval. The existing approaches based on NLP, frequency, and statistics cannot extract high quality phrases and the processing is also time consuming, which are not suitable for dynamic on-line applications. In this paper, we propose an efficient high-quality phrase mining approach (EQPM). To the best of our knowledge, our work is the first effort that considers both intra-cohesion and inter-isolation in mining phrases, which is able to guarantee appropriateness. We also propose a strategy to eliminate order sensitiveness, and ensure the completeness of phrases. We further design efficient algorithms to make the proposed model and strategy feasible. The empirical evaluations on four real data sets demonstrate that our approach achieved a considerable quality improvement and the processing time was 2.3X - 29X faster than the state-of-the-art works.
What Happens Next? Future Subevent Prediction Using Contextual Hierarchical LSTM
Hu, Linmei (Tsinghua University) | Li, Juanzi (Tsinghua University) | Nie, Liqiang (Shandong University) | Li, Xiao-Li (A*STAR) | Shao, Chao (Tsinghua University)
Events are typically composed of a sequence of subevents. Predicting a future subevent of an event is of great importance for many real-world applications. Most previous work on event prediction relied on hand-crafted features and can only predict events that already exist in the training data. In this paper, we develop an end-to-end model which directly takes the texts describing previous subevents as input and automatically generates a short text describing a possible future subevent. Our model captures the two-level sequential structure of a subevent sequence, namely, the word sequence for each subevent and the temporal order of subevents. In addition, our model incorporates the topics of the past subevents to make context-aware prediction of future subevents. Extensive experiments on a real-world dataset demonstrate the superiority of our model over several state-of-the-art methods.
Automatic Emphatic Information Extraction from Aligned Acoustic Data and Its Application on Sentence Compression
Chen, Yanju (Sun Yat-sen University) | Pan, Rong (Sun Yat-sen University)
In this paper we address the following question: can useful Specific words can be prosodically emphasized in an utterance emphatic information be automatically extracted from by a speaker in order to draw attentions on them, the prevailing acoustic data without any manual feature extraction which can be modeled by pitch accents of words (Bolinger and be used to help improve the performance of natural 1958). Also referred as prosodic prominence, pitch accent language processing tasks such as sentence compression? is found to emphasize several semantic information in an utterance While sentence compression requires the models of a such as uncertainty, contrast, turn-taking cues and so good comprehension of the semantic context and the exact on, whose changes in an utterance can be perceived by listeners intention of the input sentence, we believe the supervision and thus convey certain kinds of emphasis (Terken of additional emphatic data can be a boost to the later, and 1991). The detection of prosodic prominence shows improvements the LSTM structures dealing with the former, which will be on different tasks, such as Text-to-Speech synthesis supported by our evidence. Meanwhile, with the Speech-To- and spoken language summarization. With most of Text alignment techniques, we present a faster approach to the detections of prosodic prominence are done by using automatically extract approximate emphatic patterns from acoustic features (acoustic durations and intensities, extremity aligned acoustic data, thus lowering the cost of manual of fundamental frequency minima and maxima), there feature extraction in emphatic words detection and prediction are also works investigating predictions of emphatic words and providing weak supervision as an auxiliary task using only lexical features (Brenier, Cer, and Jurafsky 2005; to improve sentence compression performance using LSTM Brenier 2008), which shows promising results and potential structures.
Mechanism-Aware Neural Machine for Dialogue Response Generation
Zhou, Ganbin (Institute of Computing Technology,ย Chinese Academy of Sciences) | Luo, Ping (Institute of Computing Technology,ย Chinese Academy of Sciences) | Cao, Rongyu (Institute of Computing Technology,ย Chinese Academy of Sciences) | Lin, Fen (Tencent) | Chen, Bo (Tencent) | He, Qing (Institute of Computing Technology,ย Chinese Academy of Sciences)
To the same utterance, people's responses in everyday dialogue may be diverse largely in terms of content semantics, speaking styles, communication intentions and so on. Previous generative conversational models ignore these 1-to-n relationships between a post to its diverse responses, and tend to return high-frequency but meaningless responses. In this study we propose a mechanism-aware neural machine for dialogue response generation. It assumes that there exists some latent responding mechanisms, each of which can generate different responses for a single input post. With this assumption we model different responding mechanisms as latent embeddings, and develop a encoder-diverter-decoder framework to train its modules in an end-to-end fashion. With the learned latent mechanisms, for the first time these decomposed modules can be used to encode the input into mechanism-aware context, and decode the responses with the controlled generation styles and topics. Finally, the experiments with human judgements, intuitive examples, detailed discussions demonstrate the quality and diversity of the generated responses with 9.80% increase of acceptable ratio over the best of six baseline methods.
Learning Context-Specific Word/Character Embeddings
Zheng, Xiaoqing (Fudan University) | Feng, Jiangtao (Fudan University) | Chen, Yi (Fudan University) | Peng, Haoyuan (Fudan University) | Zhang, Wenqing (Fudan University)
Unsupervised word representations have demonstrated improvements in predictive generalization on various NLP tasks. Most of the existing models are in fact good at capturing the relatedness among words rather than their ''genuine'' similarity because the context representations are often represented by a sum (or an average) of the neighbor's embeddings, which simplifies the computation but ignores an important fact that the meaning of a word is determined by its context, reflecting not only the surrounding words but also the rules used to combine them (i.e. compositionality). On the other hand, much effort has been devoted to learning a single-prototype representation per word, which is problematic because many words are polysemous, and a single-prototype model is incapable of capturing phenomena of homonymy and polysemy. We present a neural network architecture to jointly learn word embeddings and context representations from large data sets. The explicitly produced context representations are further used to learn context-specific and multi-prototype word embeddings. Our embeddings were evaluated on several NLP tasks, and the experimental results demonstrated the proposed model outperformed other competitors and is applicable to intrinsically "character-based" languages.