Clearly, due to nonconvexity, the task of finding a minimizer of (1) canbequite challenging andpotentially limits what canbeguaranteed theoretically about solving problems with form(1).

In the latter, the algorithm estimates the low-rank matrix corresponding to the (state, action) value function of the current policy using the following two-phase procedure.