A Signer-Invariant Conformer and Multi-Scale Fusion Transformer for Continuous Sign Language Recognition