Goto

Collaborating Authors

 learning and inference


Learning and Inference in Hilbert Space with Quantum Graphical Models

Neural Information Processing Systems

Quantum Graphical Models (QGMs) generalize classical graphical models by adopting the formalism for reasoning about uncertainty from quantum mechanics. Unlike classical graphical models, QGMs represent uncertainty with density matrices in complex Hilbert spaces. Hilbert space embeddings (HSEs) also generalize Bayesian inference in Hilbert spaces. We investigate the link between QGMs and HSEs and show that the sum rule and Bayes rule for QGMs are equivalent to the kernel sum rule in HSEs and a special case of Nadaraya-Watson kernel regression, respectively. We show that these operations can be kernelized, and use these insights to propose a Hilbert Space Embedding of Hidden Quantum Markov Models (HSE-HQMM) to model dynamics. We present experimental results showing that HSE-HQMMs are competitive with state-of-the-art models like LSTMs and PSRNNs on several datasets, while also providing a nonparametric method for maintaining a probability distribution over continuous-valued features.


Reviews: Learning and Inference in Hilbert Space with Quantum Graphical Models

Neural Information Processing Systems

The paper develops a connection between quantum graphical models and inference with Hilbert space embeddings (HSE). It shows kernel formulations for sum rule and Bayes rule with quantum graphical models, connecting kernel mean embeddings as well as cross-covariance operators. The paper proposes to use HSE on top of HQMMs, arguing that it improves empirical performance against PSRNN and LSTMs. The paper is nicely written and does a very good job at explaining difficult quantum concepts using tools that should be familiar to a machine learning audience. I personally really enjoyed reading and learning about the connections developed in the paper.


Learning and Inference in Hilbert Space with Quantum Graphical Models

Neural Information Processing Systems

Quantum Graphical Models (QGMs) generalize classical graphical models by adopting the formalism for reasoning about uncertainty from quantum mechanics. Unlike classical graphical models, QGMs represent uncertainty with density matrices in complex Hilbert spaces. Hilbert space embeddings (HSEs) also generalize Bayesian inference in Hilbert spaces. We investigate the link between QGMs and HSEs and show that the sum rule and Bayes rule for QGMs are equivalent to the kernel sum rule in HSEs and a special case of Nadaraya-Watson kernel regression, respectively. We show that these operations can be kernelized, and use these insights to propose a Hilbert Space Embedding of Hidden Quantum Markov Models (HSE-HQMM) to model dynamics.