ATheoretical Study on Solving Continual Learning Appendix

By proof of Theorem 1, we have HCIL(x) = HWP(x)+HTP(x). Equal contribution The work was done when this author was visiting Bing Liu's group at University of Illinois at Chicago Correspondance author. According to proof of Theorem 4 ii), we have HTP(x) η. Note that ODIN is not applicable to iCaRL and Mnemonics as they are not based on softmax but some distance functions. The result for C100-10T are reported in the main paper. For the postprocessing method ODIN, we only reported the results on C100-10T due to space limitations. Tab. 5 shows the results on the other datasets. A continual learning method with a better AUC shows a better CIL performance than other methods with lower AUC.