The Importance of Positional Encoding Initialization in Transformers for Relational Reasoning

Open in new window