A Journey into Deep Reinforcement Learning

Let's start our journey by looking directly in the lion's den (Algorithm 1 below). It looks pretty scary at first sigh… But no worries, we will go through it line by line and unpack each concept. First things first, in Deep Q-Network we have a Q. And, in the beginning Sutton & Barto created the Q-function. The Q- function (a.k.a. the state-action value function), maps a couple of state, action to a value (or expected reward).