Latent Graph Attention for Enhanced Spatial Context