Maestro: Uncovering Low-Rank Structures via Trainable Decomposition