Learning to Attribute with Attention