Training

To break through the predicament of seeking supervision only from the past states, we propose future-self-training(FST), which allows the model to learn from itsfuture self. Figure 1b illustrates the concept diagram of our FST. Compared to the conventional ST framework in Figure 1a, which employs thet-step teacher (i.e., updated with the student at moments1,2,...,t 1) to guide the t-step student, FST presents a new training manner by urging thet-step student to learn from the (t+1)-stepteacher.