which, to the best of our knowledge, is not covered by existing work. TD and SGD: Our unified analysis covers both TD and SGD, where TD is not covered by any existing supervised