Collaborative Performance Prediction for Large Language Models