Multi-Transformer: A New Neural Network-Based Architecture for Forecasting S&P Volatility
Not on the map. Why?
Abstract (arXiv)
Events such as the Financial Crisis of 2007-2008 or the COVID-19 pandemic caused significant losses to banks and insurance entities. They also demonstrated the importance of using accurate equity risk models and having a risk management function able to implement effective hedging strategies. Stock volatility forecasts play a key role in the estimation of equity risk and, thus, in the management actions carried out by financial institutions. Therefore, this paper has the aim of proposing more accurate stock volatility models based on novel machine and deep learning techniques. This paper introduces a neural network-based architecture, called Multi-Transformer. Multi-Transformer is a variant of Transformer models, which have already been successfully applied in the field of natural language processing. Indeed, this paper also adapts traditional Transformer layers in order to be used in volatility forecasting models. The empirical results obtained in this paper suggest that the hybrid models based on Multi-Transformer and Transformer layers are more accurate and, hence, they lead to more appropriate risk measures than other autoregressive algorithms or hybrid models based on feed forward layers or long short term memory cells.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 5 of its 76 references that are in the map. First posted on arXiv 26 Sep 2021.
Builds on
5 of 76 references.
References · 5
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 4; 2025: 1; 2026: 1.
10 papers.
- 2022Transformer-Based Deep Learning Model for Stock Price Prediction: A Case Study on Bangladesh Stock Marketcited by 9
- 2022DeepVol: Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutionscited by 6
- 2024Quantformer: from attention to profit with a quantitative transformer trading strategycited by 6
- 2022Forecasting Bitcoin volatility spikes from whale transactions and CryptoQuant data using Synthesizer Transformer modelscited by 3
- 2024From GARCH to Neural Network for Volatility Forecastcited by 1
- 2024Trading through Earnings Seasons using Self-Supervised Contrastive Representation Learningcited by 1
- 2025Adaptive Temporal Fusion Transformers for Cryptocurrency Price Predictioncited by 1
- 2021Multivariate Realized Volatility Forecasting with Graph Neural Networkcited by 0
- 2024Uniform Ck Approximation of G-Invariant and Antisymmetric Functions, Embedding Dimensions, and Polynomial Representationscited by 0
- 2026A Hybrid Quantum Circuit Born Machine Framework for Financial Volatility Forecasting: Quantum-Assisted Training and Classical Inferencecited by 0
- 2026A Hybrid Quantum Circuit Born Machine Framework for Financial Volatility Forecasting: Quantum-Assisted Training and Classical Inference10 Mar 2026
- 2025Adaptive Temporal Fusion Transformers for Cryptocurrency Price Prediction6 Sep 2025
- 2024Trading through Earnings Seasons using Self-Supervised Contrastive Representation Learning25 Sep 2024
- 2024Quantformer: from attention to profit with a quantitative transformer trading strategy30 Mar 2024
- 2024Uniform Ck Approximation of G-Invariant and Antisymmetric Functions, Embedding Dimensions, and Polynomial Representations2 Mar 2024
- 2024From GARCH to Neural Network for Volatility Forecast29 Jan 2024
- 2022Forecasting Bitcoin volatility spikes from whale transactions and CryptoQuant data using Synthesizer Transformer models6 Oct 2022
- 2022DeepVol: Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutions23 Sep 2022
- 2022Transformer-Based Deep Learning Model for Stock Price Prediction: A Case Study on Bangladesh Stock Market17 Aug 2022
- 2021Multivariate Realized Volatility Forecasting with Graph Neural Network16 Dec 2021