On-device System of Compositional Multi-tasking in Large Language Models