Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights