Latent Alignment with Deep Set EEG Decoders