PIP: Perturbation-based Iterative Pruning for Large Language Models