Quantification of model error for inverse problems in the Weak Neural Variational Inference framework