Music Foundation Model as Generic Booster for Music Downstream Tasks