Appendix A Fine-Tuning Result for Sanity Check 17 B Training Details 17 C Model Architecture and Module Names 18 D Activation Similarity 20 D.1 Details of Experiments