Don't Forget Your Reward Values: Language Model Alignment via Value-based Calibration