MTA: A Merge-then-Adapt Framework for Personalized Large Language Model