Data augmentation has been proven effective for training high-accuracy convolu-tional neural network classifiers by preventing overfitting.

However, such a global learning rate schedule does not take into account the structural characteristics of neural networks (NNs).

Our motivation is grounded in a fundamental observation: aligning the gradient and the Hessian of the SDF provides a more efficient mechanism to govern gradient directions.

We further design an expert-wise training strategy to alleviate the impact of unhelpful demonstrations when optimizing the retriever model.