Incorporating Symbolic Sequential Modeling for Speech Enhancement