Predict the Future from the Past? On the Temporal Data Distribution Shift in Financial Sentiment Classifications
Not on the map. Why?
Abstract (arXiv)
Temporal data distribution shift is prevalent in the financial text. How can a financial sentiment analysis system be trained in a volatile market environment that can accurately infer sentiment and be robust to temporal data distribution shifts? In this paper, we conduct an empirical study on the financial sentiment analysis system under temporal data distribution shifts using a real-world financial social media dataset that spans three years. We find that the fine-tuned models suffer from general performance degradation in the presence of temporal distribution shifts. Furthermore, motivated by the unique temporal nature of the financial text, we propose a novel method that combines out-of-distribution detection with time series modeling for temporal financial sentiment analysis. Experimental results show that the proposed method enhances the model's capability to adapt to evolving temporal shifts in a volatile financial market.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 9 of its 20 references that are in the map. First posted on arXiv 19 Oct 2023.
Builds on
9 of 20 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
- 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
- 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narrativescited by 13
- 2024ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Taskscited by 11
- 2024Fully Test-time Adaptation for Tabular Datacited by 8
- 2025Language Modeling for the Future of Finance: A Survey into Metrics, Tasks, and Data Opportunitiescited by 3
- 2026Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptationcited by 1
- 2025Robust Predictive Modeling Under Unseen Data Distribution Shifts: A Methodological Commentarycited by 0
- 2026Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptation23 Apr 2026
- 2025Language Modeling for the Future of Finance: A Survey into Metrics, Tasks, and Data Opportunities9 Apr 2025
- 2025Robust Predictive Modeling Under Unseen Data Distribution Shifts: A Methodological Commentary5 Mar 2025
- 2024Fully Test-time Adaptation for Tabular Data14 Dec 2024
- 2024ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks23 May 2024
- 2024Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives21 Mar 2024