Breaking Down Bias: On The Limits of Generalizable Pruning Strategies