Fine-tuning Factor Augmented Neural Lasso for Heterogeneous Environments