A Additional Implementation Details Warming-up the KL Term: Similar to the previous work, we warm-up the KL term at the beginning