Efficient Last-iterate Convergence Algorithms in Solving Games