DAM: A Universal Dual Attention Mechanism for Multimodal Timeseries Cryptocurrency Trend Forecasting
Not on the map. Why?
Abstract (arXiv)
In the distributed systems landscape, Blockchain has catalyzed the rise of cryptocurrencies, merging enhanced security and decentralization with significant investment opportunities. Despite their potential, current research on cryptocurrency trend forecasting often falls short by simplistically merging sentiment data without fully considering the nuanced interplay between financial market dynamics and external sentiment influences. This paper presents a novel Dual Attention Mechanism (DAM) for forecasting cryptocurrency trends using multimodal time-series data. Our approach, which integrates critical cryptocurrency metrics with sentiment data from news and social media analyzed through CryptoBERT, addresses the inherent volatility and prediction challenges in cryptocurrency markets. By combining elements of distributed systems, natural language processing, and financial forecasting, our method outperforms conventional models like LSTM and Transformer by up to 20% in prediction accuracy. This advancement deepens the understanding of distributed systems and has practical implications in financial markets, benefiting stakeholders in cryptocurrency and blockchain technologies. Moreover, our enhanced forecasting approach can significantly support decentralized science (DeSci) by facilitating strategic planning and the efficient adoption of blockchain technologies, improving operational efficiency and financial risk management in the rapidly evolving digital asset domain, thus ensuring optimal resource allocation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 93 references that are in the map. First posted on arXiv 1 May 2024.
Builds on
34 of 93 references.
References · 34
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2022Transformers in Time Series: A Surveycited by 489
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2023Large Language Models in Finance: A Surveycited by 223
- 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
- 2019LSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series with Multiple Seasonal Patternscited by 23
- 2021NeuralProphet: Explainable Forecasting at Scalecited by 22
- 2022Self-Adaptive Forecasting for Improved Deep Learning on Non-Stationary Time-Seriescited by 14
22 more
- 2018Improving Stock Market Prediction via Heterogeneous Information Fusioncited by 12
- 2021A cross-modal fusion network based on self-attention and residual structure for multimodal emotion recognitioncited by 11
- 2022Transformer-Based Deep Learning Model for Stock Price Prediction: A Case Study on Bangladesh Stock Marketcited by 9
- 2018Multimodal deep learning for short-term stock volatility predictioncited by 7
- 2020Real-Time Prediction of BITCOIN Price using Machine Learning Techniques and Public Sentiment Analysiscited by 6
- 2021Information Fusion in Attention Networks Using Adaptive and Multi-level Factorized Bilinear Pooling for Audio-visual Emotion Recognitioncited by 6
- 2022Empirical Analysis of EIP-1559: Transaction Fees, Waiting Time, and Consensus Securitycited by 6
- 2023Show me your NFT and I tell you how it will perform: Multimodal representation learning for NFT selling price predictioncited by 6
- 2023Decoding Social Sentiment in DAO: A Comparative Analysis of Blockchain Governance Communitiescited by 5
- 2023A Dataset of Uniswap daily transaction indices by networkcited by 5
- 2024Analyzing Reward Dynamics and Decentralization in Ethereum 2.0: An Advanced Data Engineering Workflow and Comprehensive Datasets for Proof-of-Stake Incentivescited by 4
- 2022SoK: Blockchain Decentralizationcited by 3
- 2022Blockchain Network Analysis: A Comparative Study of Decentralized Bankscited by 2
- 2023The Design Principle of Blockchain: An Initiative for the SoK of SoKscited by 2
- 2023On the Mechanics of NFT Valuation: AI Ethics and Social Mediacited by 2
- 2023"Centralized or Decentralized?": Concerns and Value Judgments of Stakeholders in the Non-Fungible Tokens (NFTs) Marketcited by 2
- 2022Cryptocurrency Valuation: An Explainable AI Approachcited by 1
- 2022A Data Science Pipeline for Algorithmic Trading: A Comparative Study of Applications for Finance and Cryptoeconomicscited by 1
- 2022AI Ethics on Blockchain: Topic Analysis on Twitter Data for Blockchain Securitycited by 1
- 2023Understand Waiting Time in Transaction Fee Mechanism: An Interdisciplinary Perspectivecited by 1
- 2023Bitcoin Gold, Litecoin Silver:An Introduction to Cryptocurrency's Valuation and Trading Strategycited by 1
- 2024Trust Dynamics in Cryptocurrency Markets: Centralized vs. Decentralized Exchangescited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.