QWeb: Solving Web Navigation Problems using DQN

We first formulate the MDP for our problem, M S,? QWeb solves the above problem using deep Q network(DQN) to generate Q values for each state and for each atomic action. The training process is almost the same as traditional DQN with the help of reward augmentation and some curriculum learning approaches, which we will discuss later. But for now let's first focus on the architecture of QWeb, which is essentially the most fruitful part of this algorithm. Encoding user instructions: As we've seen in the preliminaries, a user instruction consists of a list of fields, i.e.,key-value pairs K, V .