JPC: Flexible Inference for Predictive Coding Networks in JAX

Innocenti, Francesco, Kinghorn, Paul, Yun-Farmbrough, Will, Varona, Miguel De Llanza, Singh, Ryan, Buckley, Christopher L.

arXiv.org Artificial Intelligence 

We introduce JPC, a JAX library for training neural networks with Predictive Coding. JPC provides a simple, fast and flexible interface to train a variety of PC networks (PCNs) including discriminative, generative and hybrid models. Unlike existing libraries, JPC leverages ordinary differential equation solvers to integrate the gradient flow inference dynamics of PCNs. We find that a second-order solver achieves significantly faster runtimes compared to standard Euler integration, with comparable performance on a range of datasets and network depths. JPC also provides some theoretical tools that can be used to study PCNs. We hope that JPC will facilitate future research of PC.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found