Getting Free Bits Back from Rotational Symmetries in LLMs