Few-shot Protein Fitness Prediction via In-context Learning and Test-time Training