Tobespecific, our 10 meta-testdatasetsinclude Histology, Drawing, Dessert, Chinese Characters, Speed Limit Signs, Alienvs Predator, Gemstones, and Dog Breeds. Thusweuse Mean Squared Error (MSE) scores.

We introduce a semidefinite programming hierarchy to estimate the global and local Lipschitz constant of a multiple layer deep neural network.

Several machine learning applications involve the optimization of higher-order derivatives(e.g., gradients ofgradients) during training, which can beexpensive with respect to memory and computation even with automatic differentiation.