General comments

We thank the reviewers for their insightful feedback. While we realize this may be subjective, even in this "oracle" setting We also notice similar patterns as Table 2 in the paper, e.g. this phenomenon is much more present in Dec-Dec attention, whereas Enc-Dec attention suffers much more from keeping only one head (-18.89 "only one head is sufficient" claim in the abstract, introduction and conclusion. We see two issues here. We will add this to the revised paper.