On the Limits of Applying Graph Transformers for Brain Connectome Classification