Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming

Manyapplicationsinmachine learning relyongradient-based optimization, oratleasttheefficient calculation of derivatives of models expressed as computer programs. Researchers have a wide variety of tools from which they can choose, particularly if they are using the Python language [21,16,24,2,1].