Supplementary Materials: Biological Credit Assignment through Dynamic Inversion of Feedforward Networks

Accurate convergence of the backward pass dynamics is crucial for the success of dynamic inversion. As noted in Section 3.2, the eigenvalues of the matrix Here we provide more details for single-loop dynamic inversion (SLDI). As mentioned in the main text, we suspect that dynamic inversion may relate to second-order methods. Following the derivations in Botev et al. (2017), we can write the block-diagonal sample A more thorough analysis is merited on the relationship between Eqs. This was not necessary for MNIST classification or MNIST autoencoding.