AlphaDecay: Module-wise Weight Decay for Heavy-Tailed Balancing in LLMs

Open in new window