Limits to Depth-Efficiencies of Self-Attention