# Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets

arXiv: https://arxiv.org/abs/1903.06478 · HTML: https://mlsanity.com/paper/1903.06478/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Mar 2019.

## Built on by (most cited first, 15 of 15)

- [AI in Finance: Challenges, Techniques and Opportunities](https://mlsanity.com/paper/2107.09051/) (2021)
- [A Review on Explainability in Multimodal Deep Neural Nets](https://mlsanity.com/paper/2105.07878/) (2021)
- [Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data](https://mlsanity.com/paper/2302.06232/) (2023)
- [Causal Inference for Time series Analysis: Problems, Methods and Evaluation](https://mlsanity.com/paper/2102.05829/) (2021)
- [Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams](https://mlsanity.com/paper/2304.10740/) (2023)
- [Bayesian Joint Additive Factor Models for Multiview Learning](https://mlsanity.com/paper/2406.00778/) (2024)
- [CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework](https://mlsanity.com/paper/2406.01414/) (2024)
- [LUMA: A Benchmark Dataset for Learning from Uncertain and Multimodal Data](https://mlsanity.com/paper/2406.09864/) (2024)
- [Multimodal Learning with Uncertainty Quantification based on Discounted Belief Fusion](https://mlsanity.com/paper/2412.18024/) (2024)
- [Multimodal Learning for Multi-Omics: A Survey](https://mlsanity.com/paper/2211.16509/) (2022)
- [VideoConviction: A Multimodal Benchmark for Human Conviction and Stock Market Recommendations](https://mlsanity.com/paper/2507.08104/) (2025)
- [Multimodal Document Analytics for Banking Process Automation](https://mlsanity.com/paper/2307.11845/) (2023)
- [A Markov Random Field Multi-Modal Variational AutoEncoder](https://mlsanity.com/paper/2408.09576/) (2024)
- [Multi-Component VAE with Gaussian Markov Random Field](https://mlsanity.com/paper/2507.12165/) (2025)
- [A Bipartite Graph Approach to U.S.-China Cross-Market Return Forecasting](https://mlsanity.com/paper/2603.10559/) (2026)

## Abstract (arXiv)

In today's increasingly international economy, return and volatility spillover effects across international equity markets are major macroeconomic drivers of stock dynamics. Thus, information regarding foreign markets is one of the most important factors in forecasting domestic stock prices. However, the cross-correlation between domestic and foreign markets is highly complex. Hence, it is extremely difficult to explicitly express this cross-correlation with a dynamical equation. In this study, we develop stock return prediction models that can jointly consider international markets, using multimodal deep learning. Our contributions are three-fold: (1) we visualize the transfer information between South Korea and US stock markets by using scatter plots; (2) we incorporate the information into the stock prediction models with the help of multimodal deep learning; (3) we conclusively demonstrate that the early and intermediate fusion models achieve a significant performance boost in comparison with the late fusion and single modality models. Our study indicates that jointly considering international stock markets can improve the prediction accuracy and deep neural networks are highly effective for such tasks.