A Training details

Neural Information Processing Systems 

We provide a pseudocode for HIQL in Algorithm 1.