Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems