The spiked matrix model with generative priors

Aubin, Benjamin, Loureiro, Bruno, Maillard, Antoine, Krzakala, Florent, Zdeborová, Lenka

Neural Information Processing Systems 

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another type is generative modelling of signal distributions. Generative models based on neural networks, such as GANs or variational auto-encoders, are particularly performant and are gaining on applicability. In this paper we study spiked matrix models, where a low-rank matrix is observed through a noisy channel. This problem with sparse structure of the spikes has attracted broad attention in the past literature.