0.1 Reinforcement Learning, A2C and V-trace

Neural Information Processing Systems 

GPU emulation in Fig.??, is not visible in this case.