A Random Matrix Analysis of In-context Memorization for Nonlinear Attention

Open in new window