Can Public Large Language Models Help Private Cross-device Federated Learning?