Revisiting Permutation Symmetry for Merging Models between Different Datasets