Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

Namely, instead of just learning predictive functions from the features to the targets of independent datapoints, NPTs can also learn to reason about general relationships between inputs.