PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration