Comparative Evaluation of Embedding Representations for Financial News Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Financial sentiment analysis enhances market understanding. However, standard Natural Language Processing (NLP) approaches encounter significant challenges when applied to small datasets. This study presents a comparative evaluation of embedding-based techniques for financial news sentiment classification in resource-constrained environments. Word2Vec, GloVe, and sentence transformer representations are evaluated in combination with gradient boosting on a manually labeled dataset of 349 financial news headlines. Experimental results identify a substantial gap between validation and test performance. Despite strong validation metrics, models underperform relative to trivial baselines. The analysis indicates that pretrained embeddings yield diminishing returns below a critical data sufficiency threshold. Small validation sets contribute to overfitting during model selection. Practical application is illustrated through weekly sentiment aggregation and narrative summarization for market monitoring. Overall, the findings indicate that embedding quality alone cannot address fundamental data scarcity in sentiment classification. Practitioners with limited labeled data should consider alternative strategies, including few-shot learning, data augmentation, or lexicon-enhanced hybrid methods.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
9 of 21 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2023Mistral 7Bcited by 3,164
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
- 2021FinEAS: Financial Embedding Analysis of Sentimentcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.