Pre-Finetuning with Impact Duration Awareness for Stock Movement Prediction
Not on the map. Why?
Abstract (arXiv)
Understanding the duration of news events' impact on the stock market is crucial for effective time-series forecasting, yet this facet is largely overlooked in current research. This paper addresses this research gap by introducing a novel dataset, the Impact Duration Estimation Dataset (IDED), specifically designed to estimate impact duration based on investor opinions. Our research establishes that pre-finetuning language models with IDED can enhance performance in text-based stock movement predictions. In addition, we juxtapose our proposed pre-finetuning task with sentiment analysis pre-finetuning, further affirming the significance of learning impact duration. Our findings highlight the promise of this novel research direction in stock movement prediction, offering a new avenue for financial forecasting. We also provide the IDED and pre-finetuned language models under the CC BY-NC-SA 4.0 license for academic use, fostering further exploration in this field.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 29 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
8 of 29 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2017Listening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Predictioncited by 60
- 2020SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysiscited by 54
- 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
- 2022Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Modelcited by 12
- 2022Cryptocurrency Bubble Detection: A New Stock Market Dataset, Financial Task & Hyperbolic Modelscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.