Reviews: Catastrophic Forgetting Meets Negative Transfer: Batch Spectral Shrinkage for Safe Transfer Learning

Neural Information Processing Systems 

The reviewer thinks that the novelty of this paper is not enough. The title of this paper is "Catastrophic Forgetting Meets Negative Transfer". However, the part that deals with catastrophic forgetting only uses the previous methods, and the formula only extends the proposed BSS regularization to the previous methods. There are also no ablation studies to verify the effectiveness of the two parts, i.e., catastrophic forgetting part and negative transfer part. So aligning all weight parameters indiscriminately to the initial pre-trained values is risky to negative transfer."