Supplementary Material for " Noisy Recurrent Neural Networks " A Notation and Background