RLlib Flow: Distributed Reinforcement Learning is a Dataflow Problem

We propose RLlib Flow, a hybrid actor-dataflow programming model for distributed RL, and validate its practicality by porting the full suite of algorithms in RLlib, a widely adopted distributed RL library.