First provide a summary of the paper, and then address the following criteria: Quality, clarity, originality and significance. This paper presents a probabilistic model for language learning. The authors cover the nature in which a pair of cooperative agents may work together to create an agreed-upon language. One question I have is how this could possibly be implemented in real-world language learning situations. Your evaluation of the emergence of phenomenon seen in real world languages makes me think you are trying to model or learn something about what real world language evolution is like.

Language system dynamics is studied at several distinct time scales (Lewis, 2014).

However, this restriction prevents it from representing value functions in which an agent's ordering over its actions can depend on

Neural Information Processing Systems http://nips.cc/

Multi-agent reinforcement learning has recently shown great promise as an approach to networked system control. Arguably, one of the most difficult and important tasks for which large scale networked system control is applicable is common-pool resource management.

In Appendix A.3 we provide statistics for the episodes used in our

Neural Information Processing Systems http://nips.cc/