Doubly-Regressing Approach for Subgroup Fairness