Neural and spectral operator surrogates: unified construction and expression rate bounds