SupplementaryMaterialforKernelIdentification ThroughTransformers ABackground: Self-Attention

Since the attention mechanism is rarely used within the GP literature, we provide a brief review of thetopicinthissection.