Qrash Course II: From Q-Learning to Gradient Policy & Actor-Critic in 12 Minutes

Let's continue our journey and introduce two more algorithms: Gradient Policy and Actor-Critic. These two, along with DQN, are probably the most fundamental building-blocks of modern Deep Reinforcement Learning. The first question we should probably ask ourselves is why should we advance from Q-Learning? Where does it fail or underperforms? Well, this algorithm does have a few pitfalls, and it's important to understand them: How should we handle these situation?