Probabilistic Reasoning in Generative Large Language Models