A More Backgrounds A.1 Distributional RL Distributional RL [ 2