Post-hoc Probabilistic Vision-Language Models