GitHub - tanyuqian/ctc-gen-eval: EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation

This repo contains code of an automatic evaluation metric described in the paper Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation Mingkai Deng*, Bowen Tan* (equal contribution), Zhengzhong Liu, Eric P. Xing, Zhiting Hu EMNLP 2021 Code to reproduce paper results can be found in the train/ folder.) We provide a command line interface (CLI) of CTC score as well as a python module. More details of these models can be found in our paper. We provide three scorers: StyleTransferScorer, SummarizationScorer, and DialogScorer. They can be used like this example below (see demo.py for more examples):