CLIPArTT: Light-weight Adaptation of CLIP to New Domains at Test Time