An Extra RMSNorm is All You Need for Fine Tuning to 1.58 Bits