Fairness Without Harm: An Influence-Guided Active Sampling Approach