PETAL Physics Emulation Through Averaged for Solving Inverse Problems