proposed idea to be impactful (all reviewers), clear (all reviewers), novel (R1,R2), principled (R3,R4) and applicable to

We thank all reviewers for their thorough reviews and insightful feedback! We will incorporate all suggested improvements in the final version. We did not compare to Zhang et al. (2019) because (1) our method is independent of We missed Zhang et al. (2020) since it was published at ACL '20 which is one month after our But we will include both and relevant multilingual MT references within it in the final version. It is the standard error after running with different seeds. In Table 4, we compared 12/100 (24.16 BLEU) to 12/24 (23.7 BLEU) so as to isolate the effect from increased encoder depths.