From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks