Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models