Appendix: On the Overlooked Pitfalls of Weight Decay and How to Mitigate Them Zeke Xie