Transformers learn to implement preconditioned gradient descent for in-context learning

Open in new window