Review for NeurIPS paper: Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention

Neural Information Processing Systems 

Weaknesses: There are multiple issues with the claims and evaluations presented in the paper. In particular, as a reader, I am not convinced that reported gains are due to exploiting gaze information. An improvement over SOTA?: For paraphrasing task, the paper claims Patro et al. (2018) as SOTA which is an outdated baseline. Given that "No Fixation" method gives 27.81 BLEU-4 score with 69M params, I doubt that the proposed model's 28.82 BLEU-4 score with 79M is truly better than Patro et al. (2018)'s model. Ideally, authors should report the performance of baseline models using the same number of parameters.