Appendix Meta-Learning with Self-Improving Momentum Target AOverview of terminologies used in the paper

The meta-learner network, i.e., learns to generalize on new tasks. Algorithm for adapting the meta-model into a task expert by using a given task dataset. Support set S. A dataset sampled from a given task distribution that is used for the adaptation. Query set Q. A dataset sampled from a given task distribution (that is disjoint with the support set) to evaluate the adaptation performance of the algorithm. Network adapted from the meta-model using the support set by using the adaptation subroutine, i.e., Adapt(,S) Momentum network moment.