AROMA: Autonomous Rank-one Matrix Adaptation