Limitations of Agents Simulated by Predictive Models