Pay Attention to What Matters