A New Approach to Ranking Over-Generated Questions

We discuss several improvements to the Question Generation Shared Task Evaluation Challenge (QGSTEC) system developed at the University of Pennsylvania in 2010. In addition to enhancing the question generation rules, we have implemented two new components to improve the ranking process. We use topic scoring, a technique developed for summarization, to identify important information for questioning, and language model probabilities to measure grammaticality. Preliminary experiments show that our approach is feasible.