Review for NeurIPS paper: An operator view of policy gradient methods
–Neural Information Processing Systems
Clarity: The clarity of this paper is very poor. Value-based is used to mean different things at different points in the paper. This makes the paper very confusing. There is value based to mean value based methods such as Q-learning or SARSA (although no reference to these algorithms or anything like them is made) in the introduction and then value-based to refer to the policy gradient theorem presented in [3]. As discussed in the correctness section, much of the paper is ambiguous and seems wrong or confused in its claims.
Neural Information Processing Systems
Jan-22-2025, 15:11:27 GMT
- Technology: