Graph Structure from Point Clouds: Geometric Attention is All You Need