Theoretical and Practical Analysis of Fr\'echet Regression via Comparison Geometry