A Learnable Prior Improves Inverse Tumor Growth Modeling