mlsanityData to 7 Oct 2026

When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing

arXiv 2203.03550 ↗First posted 17 Feb 2022cs.CL cs.AI cs.DCcited by 40

Not on the map. Why?

Abstract (arXiv)

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 17 Feb 2022.

Builds on

20 of 38 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  4. 2020Extracting Training Data from Large Language Modelscited by 2,144
  5. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  6. 2018Supervised learning with quantum enhanced feature spacescited by 654
  7. 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
  8. 2020Power of data in quantum machine learningcited by 336
  9. 2020A rigorous and robust quantum speed-up in supervised machine learningcited by 270
  10. 2019Variational Quantum Circuits for Deep Reinforcement Learningcited by 165
  11. 2018Federated Learning for Keyword Spottingcited by 95
  12. 2021Federated Quantum Machine Learningcited by 82
8 more
  1. 2021QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computercited by 65
  2. 2020Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognitioncited by 56
  3. 2020Foundations for Near-Term Quantum Natural Language Processingcited by 51
  4. 2020Quantum Natural Language Processing on Near-Term Quantum Computerscited by 39
  5. 2019Federated Learning of N-gram Language Modelscited by 33
  6. 2021QTN-VQC: An End-to-End Learning framework for Quantum Neural Networkscited by 27
  7. 2020Multi-task Language Modeling for Improving Speech Recognition of Rare Wordscited by 21
  8. 2021PATE-AAE: Incorporating Adversarial Autoencoder into Private Aggregation of Teacher Ensembles for Spoken Command Classificationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 10; 2024: 10; 2025: 12; 2026: 1.

40 papers.

Sort:

  1. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
  2. 2022Theoretical Error Performance Analysis for Variational Quantum Circuit Based Functional Regressioncited by 26
  3. 2022PQLM -- Multilingual Decentralized Portable Quantum Language Model for Privacy Protectioncited by 26
  4. 2022Quantum deep recurrent reinforcement learningcited by 23
  5. 2024Learning to Program Variational Quantum Circuits with Fast Weightscited by 23
  6. 2023Asynchronous training of quantum reinforcement learningcited by 20
  7. 2023Towards Quantum Federated Learningcited by 20
  8. 2022Certified Robustness of Quantum Classifiers against Adversarial Examples through Quantum Noisecited by 17
  9. 2023Federated Quantum Machine Learning with Differential Privacycited by 17
  10. 2025Learning to Measure Quantum Neural Networkscited by 15
  11. 2022Federated Quantum Natural Gradient Descent for Quantum Federated Learningcited by 14
  12. 2022Reservoir Computing via Quantum Recurrent Neural Networkscited by 14
28 more
  1. 2023Parallel Hybrid Networks: an interplay between quantum and classical neural networkscited by 14
  2. 2023Optimizing Quantum Federated Learning Based on Federated Quantum Natural Gradient Descentcited by 14
  3. 2023Efficient quantum recurrent reinforcement learning via quantum reservoir computingcited by 14
  4. 2024Quantum-Train-Based Distributed Multi-Agent Reinforcement Learningcited by 14
  5. 2025Toward Large-Scale Distributed Quantum Long Short-Term Memory with Modular Quantum Computerscited by 14
  6. 2024Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learningcited by 13
  7. 2024Quantum Machine Learning Architecture Search via Deep Reinforcement Learningcited by 12
  8. 2024Evolutionary Optimization for Designing Variational Quantum Circuits with High Model Capacitycited by 9
  9. 2023Quantum Federated Learning With Quantum Networkscited by 8
  10. 2024An Introduction to Quantum Reinforcement Learning (QRL)cited by 7
  11. 2025Adaptive Non-local Observable on Quantum Neural Networkscited by 7
  12. 2025Differentiable Quantum Architecture Search in Quantum-Enhanced Neural Network Parameter Generationcited by 7
  13. 2025Learning to Program Quantum Measurements for Machine Learningcited by 7
  14. 2023A hybrid quantum-classical fusion neural network to improve protein-ligand binding affinity predictions for drug discoverycited by 4
  15. 2025Quantum Natural Language Processing: A Comprehensive Review of Models, Methods, and Applicationscited by 4
  16. 2025Transfer Learning Analysis of Variational Quantum Circuitscited by 3
  17. 2025Introduction to Quantum Machine Learning and Quantum Architecture Searchcited by 3
  18. 2023Quantum deep Q learning with distributed prioritized experience replaycited by 2
  19. 2024Cascaded Cross-Modal Transformer for Audio-Textual Classificationcited by 2
  20. 2024Quantum Machine Learning: An Interplay Between Quantum Computing and Machine Learningcited by 2
  21. 2023Pre-training Tensor-Train Networks Facilitates Machine Learning with Variational Quantum Circuitscited by 1
  22. 2025Quantum Federated Learning: Architectural Elements and Future Directionscited by 1
  23. 2025Neural Architecture Search for Quantum Autoencoderscited by 1
  24. 2024Traitement quantique des langues : 'etat de l'artcited by 0
  25. 2024Hybrid Classical-Quantum architecture for vectorised image classification of hand-written sketchescited by 0
  26. 2025CLAQS: Compact Learnable All-Quantum Token Mixer with Shared-ansatz for Text Classificationcited by 0
  27. 2025A Hybrid Classical-Quantum Fine Tuned BERT for Text Classificationcited by 0
  28. 2026MADQRL: Distributed Quantum Reinforcement Learning Framework for Multi-Agent Environmentscited by 0