Improving Argument Mining in Student Essays by Learning and Exploiting Argument Indicators versus Essay Topics

AAAI Conferences

Argument mining systems for student essays need to be able to reliably identify argument components independently of particular essay topics. Thus in addition to features that model argumentation through topic-independent linguistic indicators such as discourse markers, features that can abstract over lexical signals of particular essay topics might also be helpful to improve performance. Prior argument mining studies have focused on persuasive essays and proposed a variety of largely lexicalized features. Our current study examines the utility of such features, proposes new features to abstract over the domain topics of essays, and conducts evaluations using both 10-fold cross validation as well as cross-topic validation. Experimental results show that our proposed features significantly improve argument mining performance in both types of cross-fold evaluation settings. Feature ablation studies further shed light on relative feature utility.


Criterion SM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays

AAAI Conferences

Online Essay Evaluation Service, a web-based system that provides automated scoring and evaluation of student essays. Criterion has two complementary applications: E-rater, an automated essay scoring system and Critique Writing Analysis Tools, a suite of programs that detect errors in grammar, usage, and mechanics, that identify discourse elements in the essay, and that recognize elements of undesirable style. These evaluation capabilities provide students with feedback that is specific to their writing in order to help them improve their writing skills. Both applications employ natural language processing and machine learning techniques. All of these capabilities outperform baseline algorithms, and some of the tools agree with human judges as often as two judges agree with each other.


Grammatical Error Detection for Corrective Feedback Provision in Oral Conversations

AAAI Conferences

The demand for computer-assisted language learning systems that can provide corrective feedback on language learners’ speaking has increased. However, it is not a trivial task to detect grammatical errors in oral conversations because of the unavoidable errors of automatic speech recognition systems. To provide corrective feedback, a novel method to detect grammatical errors in speaking performance is proposed. The proposed method consists of two sub-models: the grammaticality-checking model and the error-type classification model. We automatically generate grammatical errors that learners are likely to commit and construct error patterns based on the articulated errors. When a particular speech pattern is recognized, the grammaticality-checking model performs a binary classification based on the similarity between the error patterns and the recognition result using the confidence score. The error-type classification model chooses the error type based on the most similar error pattern and the error frequency extracted from a learner corpus. The grammaticality checking method largely outperformed the two comparative models by 56.36% and 42.61% in F-score while keeping the false positive rate very low. The error-type classification model exhibited very high performance with a 99.6% accuracy rate. Because high precision and a low false positive rate are important criteria for the language-tutoring setting, the proposed method will be helpful for intelligent computer-assisted language learning systems.


Python Algo Trading: Market Neutral Hedge Fund Strategy

@machinelearnbot

Update 23 Aug 2017: Do note that Quantopian platform will no longer support third party broker integration. Please see their website under forum. The title of the post is "Phasing Out Brokerage Integrations". This course provides you with the tools that top hedge funds used. These institutional tools include but are not limited to market data, fundamental data, sentiment analysis data, and more.


Developing NLP Applications Using NLTK in Python

@machinelearnbot

Have you ever faced challenges in understanding language and planning sentences while performing Natural Language Processing? Do you wish to overcome these problems and go beyond the basic techniques like bag-of-words? This course is designed with advanced solutions that will take you from newbie to pro in performing Natural Language Processing with NLTK. In this course, you will come across various concepts covering natural language understanding, Natural Language Processing, and syntactic analysis. It consists of everything you need to efficiently use NLTK to implement text classification, identify parts of speech, tag words, and more.