Attend First, Consolidate Later: On the Importance of Attention in Different LLM Layers

Open in new window