Review for NeurIPS paper: A game-theoretic analysis of networked system control for common-pool resource management using multi-agent reinforcement learning

Neural Information Processing Systems 

The paper is modelling MARL problems under the angle of social dilemma, and tries to tackle the problem of common-pool resource management. The authors do not introduce a novel method, instead this paper is a comparison of a wide range of existing relevant algorithms on a single problem (water management). The experiments are well motivated and in general, the paper is very clear. My understanding is that although the paper focuses on a water management, it is aimed as a more general survey of the quality of current MARL algorithms on common-pool resource management. The authors argue that water management is a good example to study because it is critical and life-supporting, and safety issues are very relevant.