Pay Attention to Small Weights