Overview of the Appendix 556 The Appendix is organized as follows: 557 Appendix A introduces the general experimental setup

Appendix A introduces the general experimental setup. Appendix B introduces the details of dynamic sparse training. Appendix C shows detailed algorithms, i.e., DDA, ADAPT Appendix D shows the BR evolution during training for ADAPT. Appendix E shows additional results, including IS and FID of test sets of the main paper. Appendix F shows detailed FLOPs comparisons of sparse training methods.