Supplementary Material for Kernel Identification Through Transformers A Background: Self-Attention