QiNN-QJ: A Quantum-inspired Neural Network with Quantum Jump for Multimodal Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Quantum theory provides non-classical principles, such as superposition and entanglement, that inspires promising paradigms in machine learning. However, most existing quantum-inspired fusion models rely solely on unitary or unitary-like transformations to generate quantum entanglement. While theoretically expressive, such approaches often suffer from training instability and limited generalizability. In this work, we propose a Quantum-inspired Neural Network with Quantum Jump (QiNN-QJ) for multimodal entanglement modelling. Each modality is firstly encoded as a quantum pure state, after which a differentiable module simulating the QJ operator transforms the separable product state into the entangled representation. By jointly learning Hamiltonian and Lindblad operators, QiNN-QJ generates controllable cross-modal entanglement among modalities with dissipative dynamics, where structured stochasticity and steady-state attractor properties serve to stabilize training and constrain entanglement shaping. The resulting entangled states are projected onto trainable measurement vectors to produce predictions. In addition to achieving superior performance over the state-of-the-art models on benchmark datasets, including CMU-MOSI, CMU-MOSEI, and CH-SIMS, QiNN-QJ facilitates enhanced post-hoc interpretability through von-Neumann entanglement entropy. This work establishes a principled framework for entangled multimodal fusion and paves the way for quantum-inspired approaches in modelling complex cross-modal correlations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
30 of 59 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2016The Mythos of Model Interpretabilitycited by 721
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 433
- 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 270
- 2016MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videoscited by 194
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 180
- 2022Exponential concentration in quantum kernel methodscited by 90
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2018Multimodal Sentiment Analysis using Hierarchical Fusion with Context Modelingcited by 39
18 more
- 2023GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognitioncited by 38
- 2023Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysiscited by 29
- 2023Multimodal Multi-loss Fusion Network for Sentiment Analysiscited by 27
- 2024DLF: Disentangled-Language-Focused Multimodal Sentiment Analysiscited by 27
- 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
- 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysiscited by 20
- 2021Deep Reinforcement Learning with Quantum-inspired Experience Replaycited by 19
- 2020Quantum Language Model with Entanglement Embedding for Question Answeringcited by 17
- 2019CNM: An Interpretable Complex-valued Network for Matchingcited by 13
- 2021Quantum-inspired Multimodal Fusion for Video Sentiment Analysiscited by 13
- 2025Quantum Machine Learning: A Hands-on Tutorial for Machine Learning Practitioners and Researcherscited by 12
- 2023A Quantum Probability Driven Framework for Joint Multi-Modal Sarcasm, Sentiment and Emotion Analysiscited by 9
- 2018A Quantum Many-body Wave Function Inspired Language Modeling Approachcited by 7
- 2017Learning-based Quantum Robust Control: Algorithm, Applications and Experimentscited by 6
- 2021On exploring the potential of quantum auto-encoder for learning quantum systemscited by 6
- 2021Residual Tensor Train: A Quantum-inspired Approach for Learning Multiple Multilinear Correlationscited by 3
- 2013Quantum Ensemble Classification: A Sampling-based Learning Control Approachcited by 2
- 2018Investigating non-classical correlations between decision fused multi-modal documentscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Representation Learning with Parameterised Quantum Circuits for Advancing Speech Emotion Recognition
- 2026Quantum Entangled Multimodal Fusion Networks (QEMFN): Resource-Aware Hybrid Vision-Language Fusion via Trainable Entanglement
- 2025QMoE: A Quantum Mixture of Experts Framework for Scalable Quantum Neural Networks
- 2024A Quick Introduction to Quantum Machine Learning for Non-Practitioners
- 2021Quantum Optimization for Training Quantum Neural Networks
- 2025Comparative Analysis of QNN Architectures for Wind Power Prediction: Feature Maps and Ansatz Configurations
- 2026Winning Lottery Tickets in Neural Networks via a Quantum-Inspired Classical Algorithm
- 2024QIXAI: A Quantum-Inspired Framework for Enhancing Classical and Quantum Model Transparency and Understanding