Distributional Reinforcement Learning for Multi-Dimensional Reward Functions

We prove the convergence for the joint distributional Bellman operator and build our empirical algorithm by minimizing the Maximum Mean Discrepancy between joint return distribution and its Bellman target.