Exploring Transferability of Self-Supervised Learning by Task Conflict Calibration