Inference Scaling vs Reasoning: An Empirical Analysis of Compute-Optimal LLM Problem-Solving