MuTT: A Multimodal Trajectory Transformer for Robot Skills