A Dynamic Instance Hardness .

This characteristic of DIH might be helpful to detect noisy data. We will discuss it in our future work. We will leave explanation of this phenomenon to our future works. Moreover, we provide a comparison of the smoothness between DIH and instantaneous loss on individual samples in Figure 1. We use cosine annealing learning rate schedule for multiple epochs.