Step-by-Step Mastery: Enhancing Soft Constraint Following Ability of Large Language Models