Evaluating Large Language Models for Stance Detection on Financial Targets from SEC Filing Reports and Earnings Call Transcripts
Not on the map. Why?
Abstract (arXiv)
Financial narratives from U.S. Securities and Exchange Commission (SEC) filing reports and quarterly earnings call transcripts (ECTs) are very important for investors, auditors, and regulators. However, their length, financial jargon, and nuanced language make fine-grained analysis difficult. Prior sentiment analysis in the financial domain required a large, expensive labeled dataset, making the sentence-level stance towards specific financial targets challenging. In this work, we introduce a sentence-level corpus for stance detection focused on three core financial metrics: debt, earnings per share (EPS), and sales. The sentences were extracted from Form 10-K annual reports and ECTs, and labeled for stance (positive, negative, neutral) using the advanced ChatGPT-o3-pro model under rigorous human validation. Using this corpus, we conduct a systematic evaluation of modern large language models (LLMs) using zero-shot, few-shot, and Chain-of-Thought (CoT) prompting strategies. Our results show that few-shot with CoT prompting performs best compared to supervised baselines, and LLMs' performance varies across the SEC and ECT datasets. Our findings highlight the practical viability of leveraging LLMs for target-specific stance in the financial domain without requiring extensive labeled data.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 46 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
17 of 46 references.
References · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Modelscited by 152
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 109
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
- 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
- 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
- 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
- 2024Open-FinLLMs: Open Multimodal Large Language Models for Financial Applicationscited by 36
5 more
- 2023Transforming Sentiment Analysis in the Financial Domain with ChatGPTcited by 25
- 2017Decision support from financial disclosures with deep neural networks and transfer learningcited by 18
- 2023Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language Processingcited by 11
- 2025Large Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directionscited by 6
- 2025Are Large Language Models Good In-context Learners for Financial Sentiment Analysis?cited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning or Overthinking: Evaluating Large Language Models on Financial Sentiment Analysis
- 2025Evaluating Large Language Models (LLMs) in Financial NLP: A Comparative Study on Financial Report Analysis
- 2025FinBERT2: A Specialized Bidirectional Encoder for Bridging the Gap in Finance-Specific Deployment of Large Language Models
- 2023Towards reducing hallucination in extracting information from financial reports using Large Language Models
- 2026Learning to Aggregate Zero-Shot LLM Agents for Corporate Disclosure Classification
- 2026A Training-Free, Alignment-Free Approach to Corporate Intelligence: Application to SEC Filings
- 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challenges
- 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challenges