Technology
Evaluation of Ontology Knowledge in Chinese Classical Poetry Classification
Fang, Chengyu Alex (The City University of Hong Kong) | Li, Wan Yin Claie (The City University of Hong Kong)
This paper describes preliminary research in the use of ontological knowledge for the task of automatically classifying classical Chinese poetry (CCCP) according to authorship. Based on a collection of poems written by Liu Yong (987–1053 AD) and Su Shi (1037– 1101 AD), which have been analyzed according to a taxonomy of ontological entities at the lexical level, the research looks into the issue of whether characteristic features can be automatically extracted as important stylistic differences between the two poets. This paper examines the efficiency of different ontological concepts as features in CCCP using Support Vector Machine (SVMs). The experiment shows that an integration of ontological knowledge and bags-of-words (BoW) produces a higher precision for CCCP than BoW only with an overall increase of 2.1% and 2.2% in terms of precision and F-score.
Opinion Extraction and Classification Based on Semantic Similarities
Elkhlifi, Aymen (Paris-Sorbonne University) | Bouchlaghem, Rihab (LARODEC, ISG de Tunis) | Faiz, Rim
This paper presents an automatic extraction and classification approach of opinions in texts. Therefore, we propose a similarity measurement calculating semantically similarities between a word and predefined subgroups of seed words. We have evaluated our approach on the semantic evaluation company “SemEval 2007” corpus, and we obtained promising results: the best value of Precision, 62%; and F1, 61%; as an improvement of 20 % compared to the participant systems.
Evaluating Conversational Characters Created through Question Generation
Chen, Grace (California State University Long Beach) | Tosch, Emma (Brandeis University) | Artstein, Ron (USC Institute for Creative Technologies) | Leuski, Anton ( USC Institute for Creative Technologies ) | Traum, David ( USC Institute for Creative Technologies )
Question generation tools can be used to extract a question-answer database from text articles. We investigate how suitable this technique is for giving domain-specific knowledge to conversational characters. We tested these characters by collecting questions and answers from naive participants, running the questions through the character, and comparing the system responses to the participant answers. Characters gave a full or partial answer to 53% of the user questions which had an answer available in the source text, and 43% of all questions asked. Performance was better for questions asked after the user had read the source text, and also varied by question type: the best results were answers to who questions, while answers to yes/no questions were among the poorer performers. The results show that question generation is a promising method for creating a question answering conversational character from an existing text.
Using Latent Semantic Analysis and Word Matching to Enhance Bridging Reading Strategy Identification
Brhane, Martha (Hampton University) | Boonthum-Denecke, Chutima (Hampton University)
The main goal of this study is to identify bridging reading strategy — a strategy that a reader uses to make a connection from the current sentence to previous sentences to help understanding the meaning of the text. For a specific target sentence, there are two types of bridging: local and distal. Benchmarks were created to help represent each type of bridging. The two immediate prior sentences of each target sentence together created a benchmark for the local bridging. The benchmarks for distal bridging were those prior sentences, excluding two immediate prior sentences. There were three ways that distal benchmarks were created: chunks based-on paragraph, chunks based-on target sentence, and entire collection of prior sentences. The results showed that using modified benchmark by removing up to 4 words within a threshold 0.4 has significantly improved the identification of distal bridging reading strategy by 14% from the original benchmark evaluation. On the other hand, to identify local bridging, using modified benchmark by removing 4 words has significantly improved the identification by 19% from the original benchmark evaluation.
Number of Words Versus Number Ideas: Finding a Better Predictor of Writing Quality
Weston, Jennifer L. (University of Memphis) | Crossley, Scott A. (Georgia State University) | McCarthy, Philip M. (University of Memphis) | McNamara, Danielle S. (University of Memphis)
This study examines the relation between the linguistic features of freewrites and human assessments of freewriting quality. This study builds upon the authors’ previous studies in which a model was developed based on the linguistic features of freewrites written by 9th and 11th grade students to predict freewrite quality. The current study reexamines this model using number of propositions as a predictor instead of number of words because the number of propositions was expected to be a better proxy for number of ideas in contrast to simple text length. The results indicated that there were only slight advantages for using a measure for number of propositions, indicating that from an artificial intelligence perspective, the number of words was the better measure.
Improving Spoken Dialogue Understanding Using Phonetic Mixture Models
Wang, William Yang (Columbia University) | Artstein, Ron (USC Institute for Creative Technologies) | Leuski, Anton (USC Institute for Creative Technologies) | Traum, David (USC Institute for Creative Technologies)
Augmenting word tokens with a phonetic representation, derived from a dictionary, improves the performance of a Natural Language Understanding component that interprets speech recognizer output: we observed a 5% to 7% reduction in errors across a wide range of response return rates. The best performance comes from mixture models incorporating both word and phone features. Since the phonetic representation is derived from a dictionary, the method can be applied easily without the need for integration with a specific speech recognizer. The method has similarities with autonomous (or bottom-up) psychological models of lexical access, where contextual information is not integrated at the stage of auditory perception but rather later.
Hybrid Approach Combining Machine Learning and a Rule-Based Expert System for Text Categorization
Villena-Román, Julio (Universidad Carlos III de Madrid) | Collada-Pérez, Sonia (Daedalus - Data, Decisions and Language, S.A.) | Lana-Serrano, Sara (Universidad Politécnica de Madrid) | González-Cristóbal, José Carlos (Universidad Politécnica de Madrid)
This paper discusses a novel hybrid approach for text categorization that combines a machine learning algorithm, which provides a base model trained with a labeled corpus, with a rule-based expert system, which is used to improve the results provided by the previous classifier, by filtering false positives and dealing with false negatives. The main advantage is that the system can be easily fine-tuned by adding specific rules for those noisy or conflicting categories that have not been successfully trained. We also describe an implementation based on k-Nearest Neighbor and a simple rule language to express lists of positive, negative and relevant (multiword) terms appearing in the input text. The system is evaluated in several scenarios, including the popular Reuters-21578 news corpus for comparison to other approaches, and categorization using IPTC metadata, EUROVOC thesaurus and others. Results show that this approach achieves a precision that is comparable to top ranked methods, with the added value that it does not require a demanding human expert workload to train.
Disambiguation and Filtering Methods in Using Web Knowledge for Coreference Resolution
Uryupina, Olga (CiMEC, University of Trento) | Poesio, Massimo (CiMEC, University of Trento) | Giuliano, Claudio (Fondazione Bruno Kessler) | Tymoshenko, Kateryna (Fondazione Bruno Kessler)
We investigate two publicly available web knowledge bases, Wikipedia and Yago, in an attempt to leverage semantic information and increase the performance level of a state-of-the-art coreference resolution (CR) engine. We extract semantic compatibility and aliasing information from Wikipedia and Yago, and incorporate it into a CR system. We show that using such knowledge with no disambiguation and filtering does not bring any improvement over the baseline, mirroring the previous findings. We propose, therefore, a number of solutions to reduce the amount of noise coming from web resources: using disambiguation tools for Wikipedia, pruning Yago to eliminate the most generic categories and imposing additional constraints on affected mentions. Our evaluation experiments on the ACE-02 corpus show that the knowledge, extracted from Wikipedia and Yago, improves our system's performance by 2-3 percentage points.
Using Centrality Algorithms on Directed Graphs for Synonym Expansion
Sinha, Ravi Som (University of North Texas) | Mihalcea, Rada Flavia (University of North Texas)
This paper presents our explorations in using graph centrality measures to solve the synonym expansion problem. In particular, we use the concept of directional similarity to derive directed graphs on which we apply centrality algorithms to identify the most likely synonyms for a target word in a given context. We show that our method can lead to performance comparable to the state-of-the-art.
Event Extraction Approach for French Language
Sellmi, Oussama (SOIE, ISG de Tunis)
S. Tenier, A. Napoli, X. Polanco and Y.Toussaint (2006) With the proliferation of news articles from thousands of developed an automatic WebPages semantic annotation different sources now available on the Web, summarization system. The objective is to classify pages concerning teams of such information is becoming increasingly important. of research, in order to be able to determine for example Considering the large number of news source (for who works where, on what and with whom (use of examples, BBC, Reuters, CNN…), every day, thousands of ontology of the domain). It consists, first, of the articles are produced in the entire world concerning a given identification of the syntactic structure characterizing the event.