Rough Transformers: Lightweight Continuous-Time Sequence Modelling with Path Signatures