Efficiently Attacking Memorization Scores