Finite-Time Analysis of Adaptive Temporal Difference Learning with Deep Neural Networks

However, from the theoretical perspective, establishing theoretical convergence guarantees for training DNNs is much more complicated than that for the linear approximation algorithms, which is still widely open.