Vulnerability-Aware Alignment: Mitigating Uneven Forgetting in Harmful Fine-Tuning