Physics Enhanced Deep Surrogates for the Phonon Boltzmann Transport Equation