Sequential Memory with Temporal Predictive Coding Supplementary Materials

In Algorithm 1 we present the memorizing and recalling procedures of the single-layer tPC. In Algorithm 2 we present the memorizing and recalling procedures of the 2-layer tPC. It is worth noting that, although in both algorithms we used iterative inference (line 14-16 in Algorithm 1 and line 17-19 in Algorithm 2), these inferential dynamics can be replaced by forward passes in simulation. However, obtaining the retrievals via iterative methods allows us to implement the computations in the plausible neural circuits in Figure 1 whereas forward passes cannot. Code will be available upon acceptance.