Navigating the Designs of Privacy-Preserving Fine-tuning for Large Language Models