Provably Data-driven Multiple Hyper-parameter Tuning with Structured Loss Function