Noisy Test-Time Adaptation in Vision-Language Models