The high-level intuition behind MDP-GapE is that unlike a purely optimistic policy, 2