Balancing Act: Constraining Disparate Impact in Sparse Models