A First Full Physics Benchmark for Highly Granular Calorimeter Surrogates