Goto

Collaborating Authors

 Uncertainty




A Defining Markov locality and relating it to p locality

Neural Information Processing Systems

Markov locality, which will use the language of Markov blankets. Markov blanket but not all blankets are boundaries. A Markov boundary can be thought of as the set of variables that'locally' communicate with the parameter Importantly, for Markov-locality to be of use, we would like the Markov boundaries of random variables in the model of interest to be unique. Assume all quantities are as in A.1, that the conditional independence relationships This proof relies on Lemma A.1, proved below. We wish to prove Eq. 2 Eq.


Formalizing locality for normative synaptic plasticity models Colin Bredenberg

Neural Information Processing Systems

Over the last several decades, computational neuroscience researchers have proposed a variety of "biologically plausible" models of synaptic plasticity that seek to provide normative accounts of a variety of learning processes in the brain--these models aim to explain how modifications of




Supplementary Materials Posterior Collapse and Latent Variable Non-identifiability A Examples of posterior collapse continued

Neural Information Processing Systems

We consider classical probabilistic principal component analysis ( PPCA) and show that its local latent variables can suffer from posterior collapse at maximum likelihood parameter values (i.e. 's are the latent variables of interest and others's are not (fully) identifiable in this However, it is nearly non-identifiable. While the two data generating clusters are different, they are very similar to each other because they overlap. We first define the most general form of LIDV AE . The key difference is in Eq. 19, where the classical VA E uses an arbitrary function General LIDV AE emulate many existing VA E . This general LIDV AE also subsumes the Bernoulli mixture model, which is a common variant of LIDGMV AE for the MNIST data. Moreover, for any data distribution generated by the classical VA E ( Eqs. 17 to 19), there exists an LIDV AE that can generate the same distribution.