4eab60e55fe4c7dd567a0be28016bff3-AuthorFeedback.pdf

Clearly,thischoice5 does not rely on the mixing timetmix, minimum state-action occupancy probabilityµmin, and target accuracyε.6 Consider asynchronous Q-learning with learning8 rates (1). More specifically, this requires two changes: (1) the epoch length needs to keep increasing (i.e. at the end of every12 Wewilladdthisintherevision.31 Specific questions by Reviewer 3: "Asynchronous Q-learning vs. A3C": We'd like to clarify a possible source of32 confusion due to the different use of terminology in two different topics.