Comparison and Adaptation of Automatic Evaluation Metrics for Quality Assessment of Re-Speaking

One of the main driving forces in Speech Technology, for the last several years, comes from the efforts of various groups and organizations tackling with the issue of disability, specifically deaf and hard of hearing people. Most notably, a long term effort by such organisations has lead to a plan by the European Commision to enable "Subtitling of 100% of programs in public TV all over the EU by 2020 with simple technical standards and consumer friendly rules" [15]. This ambitious task would not be possible to achieve without the aid of Speech Technology. While there has been a considerable improvement of quality of Automatic Speech Recognition (ASR) technology recently, many of the tasks present in real-life are simply beyond complete automation. On the other hand, there are tasks, which are also impossible to achieve by humans without the aid of ASR.