Parameter-efficient Quantum Multi-task Learning
Not on the map. Why?
Abstract (arXiv)
Multi-task learning (MTL) improves generalization and data efficiency by jointly learning related tasks through shared representations. In the widely used hard-parameter-sharing setting, a shared backbone is combined with task-specific prediction heads. However, task-specific parameters can grow rapidly with the number of tasks. Therefore, designing multi-task heads that preserve task specialization while improving parameter efficiency remains a key challenge. In Quantum Machine Learning (QML), variational quantum circuits (VQCs) provide a compact mechanism for mapping classical data to quantum states residing in high-dimensional Hilbert spaces, enabling expressive representations within constrained parameter budgets. We propose a parameter-efficient quantum multi-task learning (QMTL) framework that replaces conventional task-specific linear heads with a fully quantum prediction head in a hybrid architecture. The model consists of a VQC with a shared, task-independent quantum encoding stage, followed by lightweight task-specific ansatz blocks enabling localized task adaptation while maintaining compact parameterization. Under a controlled and capacity-matched formulation where the shared representation dimension grows with the number of tasks, our parameter-scaling analysis demonstrates that a standard classical head exhibits quadratic growth, whereas the proposed quantum head parameter cost scales linearly. We evaluate QMTL on three multi-task benchmarks spanning natural language processing, medical imaging, and multimodal sarcasm detection, where we achieve performance comparable to, and in some cases exceeding, classical hard-parameter-sharing baselines while consistently outperforming existing hybrid quantum MTL models with substantially fewer head parameters. We further demonstrate QMTL's executability on noisy simulators and real quantum hardware, illustrating its feasibility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
26 of 44 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2018Deep contextualized word representationscited by 2,290
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2017A Survey on Multi-Task Learningcited by 840
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2016Cross-stitch Networks for Multi-task Learningcited by 467
14 more
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
- 2020Power of data in quantum machine learningcited by 338
- 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 174
- 2017Routing Networks: Adaptive Selection of Non-linear Functions for Multi-Task Learningcited by 126
- 2021Encoding-dependent generalization bounds for parametrized quantum circuitscited by 82
- 2023Recon: Reducing Conflicting Gradients from the Root for Multi-Task Learningcited by 51
- 2019Many Task Learning with Task Routingcited by 50
- 2024Proactive Gradient Conflict Mitigation in Multi-Task Learning: A Sparse Training Perspectivecited by 12
- 2023Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Taskscited by 10
- 2026Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projectioncited by 8
- 2024A Hybrid Quantum Neural Network for Split Learningcited by 5
- 2025Contextual Quantum Neural Networks for Stock Price Predictioncited by 4
- 2025Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptationcited by 1
Built on by
Not cited yet.