EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Engine Jiayi Weng Min Lin

Neural Information Processing Systems 

Deep Reinforcement Learning (RL) has made remarkable progress in the past years.