One-layer transformers fail to solve the induction heads task

Open in new window