mlsanityData to 14 Oct 2026

Multi-Scale Feature Fusion Quantum Depthwise Convolutional Neural Networks for Text Classification

arXiv 2405.13515 ↗First posted 22 May 2024quant-ph cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, with the development of quantum machine learning, quantum neural networks (QNNs) have gained increasing attention in the field of natural language processing (NLP) and have achieved a series of promising results. However, most existing QNN models focus on the architectures of quantum recurrent neural network (QRNN) and self-attention mechanism (QSAM). In this work, we propose a novel QNN model based on quantum convolution. We develop the quantum depthwise convolution that significantly reduces the number of parameters and lowers computational complexity. We also introduce the multi-scale feature fusion mechanism to enhance model performance by integrating word-level and sentence-level features. Additionally, we propose the quantum word embedding and quantum sentence embedding, which provide embedding vectors more efficiently. Through experiments on two benchmark text classification datasets, we demonstrate our model outperforms a wide range of state-of-the-art QNN models. Notably, our model achieves a new state-of-the-art test accuracy of 96.77% on the RP dataset. We also show the advantages of our quantum model over its classical counterparts in its ability to improve test accuracy using fewer parameters. Finally, an ablation test confirms the effectiveness of the multi-scale feature fusion mechanism and quantum depthwise convolution in enhancing model performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 78 references that are in the map. First posted on arXiv 22 May 2024.

Builds on

31 of 78 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  6. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  8. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  9. 2020Variational Quantum Algorithmscited by 692
  10. 2018Barren plateaus in quantum neural network training landscapescited by 630
  11. 2016Quantum Machine Learningcited by 326
  12. 2023Challenges and Opportunities in Quantum Machine Learningcited by 203
19 more
  1. 2020Absence of Barren Plateaus in Quantum Convolutional Neural Networkscited by 125
  2. 2020Quantum Long Short-Term Memorycited by 120
  3. 2020Recurrent Quantum Neural Networkscited by 80
  4. 2021Noisy intermediate-scale quantum (NISQ) algorithmscited by 79
  5. 2021QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computercited by 67
  6. 2021The Dawn of Quantum Natural Language Processingcited by 61
  7. 2014Rigid-Motion Scattering for Texture Classificationcited by 52
  8. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 43
  9. 2022QSAN: A Near-term Achievable Quantum Self-Attention Networkcited by 25
  10. 2023Quantum Recurrent Neural Networks for Sequential Learningcited by 25
  11. 2023QKSAN: A Quantum Kernel Self-Attention Networkcited by 23
  12. 2021Quantum Neural Networks: Concepts, Applications, and Challengescited by 21
  13. 2022Classical-to-quantum convolutional neural network transfer learningcited by 18
  14. 2022Quantum Neural Network Classifiers: A Tutorialcited by 13
  15. 2022Rapid training of quantum recurrent neural networkscited by 13
  16. 2024Quantum Mixed-State Self-Attention Networkcited by 11
  17. 2023Time-Warping Invariant Quantum Recurrent Neural Networks via Quantum-Classical Adaptive Gatingcited by 5
  18. 2023Quantum Convolutional Neural Networks for Multi-Channel Supervised Learningcited by 4
  19. 2023VQNet 2.0: A New Generation Machine Learning Framework that Unifies Classical and Quantumcited by 2

Built on by

Not cited yet.