Computing Higher Order Derivatives of Matrix and Tensor Expressions

Soeren Laue, Matthias Mitterreiter, Joachim Giesen

Neural Information Processing Systems 

Optimization is an integral part of most machine learning systems and most numerical optimization schemes relyonthecomputation ofderivatives.