Maximum Entropy Reinforcement Learning via Energy-Based Normalizing Flow

In the policy evaluation steps, the critic is updated to capture the soft Q-function. In the policy improvement steps, the actor is adjusted in accordance with the updated soft Q-function.