Entanglement as a Structural Complexity Axis: A PAC-Bayesian View of Generalization in Quantum Policies and Value Functions
On the map: Deep reinforcement learning methods → Quantum reinforcement learning
Abstract (arXiv)
Parameterized quantum circuits (PQCs) are increasingly used as policies and value functions in quantum reinforcement learning, yet it remains unclear when and why quantum policies generalize. We give a PAC-Bayesian account in which generalization is governed not by the raw number of circuit parameters, but by the effective dimension of the Fisher geometry induced by the circuit. This quantity is inflated by entanglement, making entangling connectivity an independent axis of complexity.In controlled experiments that fix the number of trainable rotations and vary only entanglement, we find that circuits with larger Fisher effective dimension exhibit larger train-test gaps, while parameter count is a weak predictor. The resulting bound acts primarily as a ranking certificate: it correctly orders circuits with identical parameter count, which parameter-counting bounds cannot do. We validate this mechanism across supervised classification, quantum contextual bandits, and value-function generalization, where entangled circuits consistently generalize worse than non-entangled circuits of equal parameter count, with gaps shrinking as sample size increases.Our strongest evidence comes from low-variance decision models, including single-observable classifiers, value heads, and one-step policies. In end-to-end multi-step policy learning, entanglement effects remain statistically significant but high return variance leaves the full ordering only partially resolved. Partial-correlation analysis shows that Fisher effective dimension screens off entangling pattern, and controls for training accuracy, readout, and optimizer rule out major optimization confounders. The effect also persists on an IBM Heron quantum processor under real noise. Overall, our results reframe quantum policy design around an entanglement--generalization trade-off rather than expressivity alone.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Quantum reinforcement learning, one of 15 directions in Deep reinforcement learning methods. Builds on 10 of its 13 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
10 of 13 references.
Closest ancestors · 2
Same direction, newest first
- 2025Quantum Reinforcement Learning by Adaptive Non-local Observables25 Jul
- 2024VQC-Based Reinforcement Learning with Data Re-uploading: Performance and Trainability21 Jan
Other references · 8
- 2017Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Datacited by 533
- 2020The power of quantum neural networkscited by 379
- 2021Generalization in quantum machine learning from few training datacited by 216
- 2023Understanding quantum machine learning also requires rethinking generalizationcited by 49
- 2020Quantum reinforcement learning in continuous action spacecited by 29
- 2018PAC-Bayes Control: Learning Policies that Provably Generalize to Novel Environmentscited by 22
- 2026A PAC-Bayesian approach to generalization for quantum modelscited by 2
- 2025PAC-Bayesian Reinforcement Learning Trains Generalizable Policiescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Quantum entanglement provides a competitive advantage in adversarial games
- 2024Trainability issues in quantum policy gradients
- 2025Prospects for quantum advantage in machine learning from the representability of functions
- 2026Quantum Advantage in Multi Agent Reinforcement Learning
- 2024Reinforced Disentanglers on Random Unitary Circuits
- 2025Reinforcement Learning for Optimizing Large Qubit Array based Quantum Sensor Circuits
- 2025Quantum Decision Transformers (QDT): Synergistic Entanglement and Interference for Offline Reinforcement Learning
- 2026Learning to Coordinate via Quantum Entanglement in Multi-Agent Reinforcement Learning