Self-attention Networks Localize When QK-eigenspectrum Concentrates

Open in new window