QuanVI: Score-based Variational Inference via Quantum Maximally Mixed States
Not on the map. Why?
Abstract (arXiv)
Score-based variational inference (VI) provides an alternative to Kullback--Leibler (KL)-based VI by minimizing the Fisher divergence between the variational distribution and the target. A prior score-VI approach formulates this optimization as an eigenvalue problem, with the variational distribution constructed from low-energy eigenstates. However, this eigenvalue-based formulation faces two high-dimensional obstacles: an intractably large parameter count due to exponential scaling and non-uniqueness of individual eigenvectors in degenerate or nearly degenerate low-energy subspaces. We propose QuanVI, a scalable quantum-inspired algorithm that combines a mixed-state density-operator formulation with a quantum tensor network (QTN) parameterization using the matrix product operator (MPO) structure. In degenerate low-energy subspaces, the density-operator formulation represents the subspace by its maximally mixed state rather than relying on a non-unique individual eigenvector, while the QTN parameterization compresses the density operator to avoid exponential parameter growth. Experiments and ablations show that QuanVI agrees with exact solutions in low dimensions and scales to high-dimensional synthetic and Bayesian posterior-approximation benchmarks, including challenging non-Gaussian targets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
19 of 33 references.
References · 19
- 2016Variational Inference: A Review for Statisticianscited by 1,472
- 2013Black Box Variational Inferencecited by 319
- 2015Tensorizing Neural Networkscited by 250
- 2016Automatic Differentiation Variational Inferencecited by 159
- 2016Tensor Ring Decompositioncited by 127
- 2017Unsupervised Generative Modeling Using Matrix Product Statescited by 88
- 2019Expressive power of tensor-network factorizations for probabilistic modeling, with applications from hidden Markov models to quantum machine learningcited by 55
- 2017Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations. Part 2 Applications and Future Perspectivescited by 54
- 2017Tensor Regression Networkscited by 44
- 2014Stochastic Backpropagation and Approximate Inference in Deep Generative Modelscited by 31
- 2021Tensor-Train Density Estimationcited by 30
- 2024QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptationcited by 23
7 more
- 2024Batch and match: black-box variational inference with a score-based divergencecited by 22
- 2023Semi-Implicit Variational Inference via Score Matchingcited by 19
- 2023Variational Inference with Gaussian Score Matchingcited by 17
- 2024EigenVI: score-based variational inference with orthogonal function expansionscited by 11
- 2023Generative Learning of Continuous Data by Tensor Networkscited by 9
- 2025Variational Inference with Mixtures of Isotropic Gaussianscited by 6
- 2025Fisher meets Feynman: score-based variational inference with a product of expertscited by 2
Built on by
Not cited yet.