From Coefficients to Directions: Rethinking Model Merging with Directional Alignment