RePAST: Relative Pose Attention Scene Representation Transformer