In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization
–Neural Information Processing Systems
The non-zero mean in task prior captures a common scenario where tasks share a signal.
Neural Information Processing Systems
May-28-2025, 17:53:39 GMT