Meta-Learning with Self-Improving Momentum Target

Neural Information Processing Systems 

However, obtaining a target model for each task can be highly expensive, especially when the number of tasks for meta-learning is large.