Improving Adaptivity via Over-Parameterization in Sequence Models