Convergence Guarantee of Dynamic Programming for LTL Surrogate Reward