Review for NeurIPS paper: Incorporating Pragmatic Reasoning Communication into Emergent Language

Weaknesses: Both general lines of work in this paper, on emergent language to learn speakers and listeners, and on explicit pragmatic reasoning to improve communicative success or efficiency, have been explored in prior work. Their integration here was limited to using speakers and listeners learned through emergent communication as the base models in pragmatic reasoning. I appreciate the approaches the paper uses, but I felt that its aims were currently ill-defined, and the contributions were too spread over several areas so that each of them is thin or unclear. For each of the contributions above, 1) Since, as the paper points out, the GameTable-sequential is essentially an upper bound on communicative accuracy, the results in 4.2 are largely useful for analyzing the relative merits of the methods, but details about the proposed game equilbria method, and the comparisons to past work, were unclear. Emergent communication gives a framework to investigate compositionality or efficiency of language, or concept formation, and the qualitative analysis in 4.4 is a partial step toward this, but it's unclear how representative these examples are.