Dynamics of "Spontaneous" Topic Changes in Next Token Prediction with Self-Attention

Open in new window