Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot

Open in new window