mlsanityData to 14 Oct 2026

Stock Movement Prediction with Multimodal Stable Fusion via Gated Cross-Attention Mechanism

arXiv 2406.06594 ↗First posted 6 Jun 2024q-fin.CP cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

The accurate prediction of stock movements is crucial for investment strategies. Stock prices are subject to the influence of various forms of information, including financial indicators, sentiment analysis, news documents, and relational structures. Predominant analytical approaches, however, tend to address only unimodal or bimodal sources, neglecting the complexity of multimodal data. Further complicating the landscape are the issues of data sparsity and semantic conflicts between these modalities, which are frequently overlooked by current models, leading to unstable performance and limiting practical applicability. To address these shortcomings, this study introduces a novel architecture, named Multimodal Stable Fusion with Gated Cross-Attention (MSGCA), designed to robustly integrate multimodal input for stock movement prediction. The MSGCA framework consists of three integral components: (1) a trimodal encoding module, responsible for processing indicator sequences, dynamic documents, and a relational graph, and standardizing their feature representations; (2) a cross-feature fusion module, where primary and consistent features guide the multimodal fusion of the three modalities via a pair of gated cross-attention networks; and (3) a prediction module, which refines the fused features through temporal and dimensional reduction to execute precise movement forecasting. Empirical evaluations demonstrate that the MSGCA framework exceeds current leading methods, achieving performance gains of 8.1%, 6.1%, 21.7% and 31.6% on four multimodal datasets, respectively, attributed to its enhanced multimodal fusion stability.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 83 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

35 of 83 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2017Graph Attention Networkscited by 8,923
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2019Towards VQA Models That Can Readcited by 1,718
  8. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  9. 2016Language Modeling with Gated Convolutional Networkscited by 702
  10. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  11. 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 339
  12. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
23 more
  1. 2016Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Groundingcited by 243
  2. 2016Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioningcited by 232
  3. 2022Transformer Quality in Linear Timecited by 191
  4. 2022Are Multimodal Transformers Robust to Missing Modality?cited by 186
  5. 2016Exploring the Limits of Language Modelingcited by 173
  6. 2021SelfDoc: Self-Supervised Document Representation Learningcited by 117
  7. 2014Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognitioncited by 111
  8. 2018Temporal Relational Ranking for Stock Predictioncited by 102
  9. 2017Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answeringcited by 79
  10. 2020Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learningcited by 74
  11. 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
  12. 2023A Transformer-based representation-learning model with unified processing of multimodal input for clinical diagnosticscited by 43
  13. 2022Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysiscited by 22
  14. 2022Efficient Integration of Multi-Order Dynamics and Internal Dynamics in Stock Movement Predictioncited by 18
  15. 2022Is Cross-Attention Preferable to Self-Attention for Multi-Modal Emotion Recognition?cited by 16
  16. 2020Multi-Graph Convolutional Network for Relationship-Driven Stock Movement Predictioncited by 13
  17. 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
  18. 2022Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Modelcited by 12
  19. 2019Factorized Inference in Deep Markov Models for Incomplete Multimodal Time Seriescited by 10
  20. 2021Graph-Based Learning for Stock Movement Prediction with Textual and Relational Datacited by 8
  21. 2023Support for Stock Trend Prediction Using Transformers and Sentiment Analysiscited by 4
  22. 2019Multi-Label Product Categorization Using Multi-Modal Fusion Modelscited by 3
  23. 2021Multi-modal Attention Network for Stock Movements Predictioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.