Stock Movement Prediction with Multimodal Stable Fusion via Gated Cross-Attention Mechanism
Not on the map. Why?
Abstract (arXiv)
The accurate prediction of stock movements is crucial for investment strategies. Stock prices are subject to the influence of various forms of information, including financial indicators, sentiment analysis, news documents, and relational structures. Predominant analytical approaches, however, tend to address only unimodal or bimodal sources, neglecting the complexity of multimodal data. Further complicating the landscape are the issues of data sparsity and semantic conflicts between these modalities, which are frequently overlooked by current models, leading to unstable performance and limiting practical applicability. To address these shortcomings, this study introduces a novel architecture, named Multimodal Stable Fusion with Gated Cross-Attention (MSGCA), designed to robustly integrate multimodal input for stock movement prediction. The MSGCA framework consists of three integral components: (1) a trimodal encoding module, responsible for processing indicator sequences, dynamic documents, and a relational graph, and standardizing their feature representations; (2) a cross-feature fusion module, where primary and consistent features guide the multimodal fusion of the three modalities via a pair of gated cross-attention networks; and (3) a prediction module, which refines the fused features through temporal and dimensional reduction to execute precise movement forecasting. Empirical evaluations demonstrate that the MSGCA framework exceeds current leading methods, achieving performance gains of 8.1%, 6.1%, 21.7% and 31.6% on four multimodal datasets, respectively, attributed to its enhanced multimodal fusion stability.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 83 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
35 of 83 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2019Towards VQA Models That Can Readcited by 1,718
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 339
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
23 more
- 2016Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Groundingcited by 243
- 2016Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioningcited by 232
- 2022Transformer Quality in Linear Timecited by 191
- 2022Are Multimodal Transformers Robust to Missing Modality?cited by 186
- 2016Exploring the Limits of Language Modelingcited by 173
- 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
- 2014Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognitioncited by 111
- 2018Temporal Relational Ranking for Stock Predictioncited by 102
- 2017Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answeringcited by 79
- 2020Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learningcited by 74
- 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
- 2023A Transformer-based representation-learning model with unified processing of multimodal input for clinical diagnosticscited by 43
- 2022Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysiscited by 22
- 2022Efficient Integration of Multi-Order Dynamics and Internal Dynamics in Stock Movement Predictioncited by 18
- 2022Is Cross-Attention Preferable to Self-Attention for Multi-Modal Emotion Recognition?cited by 16
- 2020Multi-Graph Convolutional Network for Relationship-Driven Stock Movement Predictioncited by 13
- 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
- 2022Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Modelcited by 12
- 2019Factorized Inference in Deep Markov Models for Incomplete Multimodal Time Seriescited by 10
- 2021Graph-Based Learning for Stock Movement Prediction with Textual and Relational Datacited by 8
- 2023Support for Stock Trend Prediction Using Transformers and Sentiment Analysiscited by 4
- 2019Multi-Label Product Categorization Using Multi-Modal Fusion Modelscited by 3
- 2021Multi-modal Attention Network for Stock Movements Predictioncited by 2
Built on by
Citing papers per year: 2025: 3.
3 papers.
- 2025Gating is Weighting: Understanding Gated Linear Attention through In-context Learningcited by 12
- 2025Multimodal Language Models with Modality-Specific Experts for Financial Forecasting from Interleaved Sequences of Text and Time Seriescited by 2
- 2025Predicting Stock Movement with BERTweet and Transformerscited by 0
- 2025Multimodal Language Models with Modality-Specific Experts for Financial Forecasting from Interleaved Sequences of Text and Time Series23 Sep 2025
- 2025Gating is Weighting: Understanding Gated Linear Attention through In-context Learning6 Apr 2025
- 2025Predicting Stock Movement with BERTweet and Transformers13 Mar 2025