mlsanityData to 14 Oct 2026

A Hybrid Classical-Quantum Fine Tuned BERT for Text Classification

arXiv 2511.17677 ↗First posted 21 Nov 2025cs.LG quant-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical-quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

20 of 41 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  4. 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
  5. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  6. 2019How to Fine-Tune BERT for Text Classification?cited by 411
  7. 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
  8. 2019Revealing the Dark Secrets of BERTcited by 301
  9. 2020Revisiting Few-sample BERT Fine-tuningcited by 238
  10. 2019Transfer learning in hybrid classical-quantum neural networkscited by 114
  11. 2019Portuguese Named Entity Recognition using BERT-CRFcited by 73
  12. 2019BERT with History Answer Embedding for Conversational Question Answeringcited by 67
8 more
  1. 2021QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computercited by 67
  2. 2021Variational Quantum Reinforcement Learning via Evolutionary Optimizationcited by 50
  3. 2021lambeq: An Efficient High-Level Python Library for Quantum NLPcited by 44
  4. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 43
  5. 2022When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computingcited by 40
  6. 2020Quantum-inspired Machine Learning on high-energy physics datacited by 31
  7. 2020Hybrid quantum-classical classifier based on tensor network and variational quantum circuitcited by 26
  8. 2016Quantum Algorithms for Compositional Natural Language Processingcited by 24

Built on by

Not cited yet.