Generalized Leverage Score Sampling for Neural Networks