Sequences of Logits Reveal the Low Rank Structure of Language Models