Dual input stream transformer for eye-tracking line assignment