SpotDiff: Spotting and Disentangling Interference in Feature Space for Subject-Preserving Image Generation