Bridging Language Models and Financial Analysis
Not on the map. Why?
Abstract (arXiv)
The rapid advancements in Large Language Models (LLMs) have unlocked transformative possibilities in natural language processing, particularly within the financial sector. Financial data is often embedded in intricate relationships across textual content, numerical tables, and visual charts, posing challenges that traditional methods struggle to address effectively. However, the emergence of LLMs offers new pathways for processing and analyzing this multifaceted data with increased efficiency and insight. Despite the fast pace of innovation in LLM research, there remains a significant gap in their practical adoption within the finance industry, where cautious integration and long-term validation are prioritized. This disparity has led to a slower implementation of emerging LLM techniques, despite their immense potential in financial applications. As a result, many of the latest advancements in LLM technology remain underexplored or not fully utilized in this domain. This survey seeks to bridge this gap by providing a comprehensive overview of recent developments in LLM research and examining their applicability to the financial sector. Building on previous survey literature, we highlight several novel LLM methodologies, exploring their distinctive capabilities and their potential relevance to financial data analysis. By synthesizing insights from a broad range of studies, this paper aims to serve as a valuable resource for researchers and practitioners, offering direction on promising research avenues and outlining future opportunities for advancing LLM applications in finance.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 163 of its 265 references that are in the map. First posted on arXiv 14 Mar 2025.
Builds on
163 of 265 references.
References · 163
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
38 more
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2023Active Retrieval Augmented Generationcited by 506
- 2024Large Language Models: A Surveycited by 506
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 419
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
- 2022Reasoning with Language Model Prompting: A Surveycited by 251
- 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
- 2023Large Language Models in Finance: A Surveycited by 223
- 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
- 2023A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendationscited by 200
50 most cited of 163 All 163 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomycited by 5
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheetscited by 4
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Modelscited by 3
- 2026Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systemscited by 1
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheets7 Mar 2026
- 2026Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systems25 Jan 2026
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models8 Jan 2026
- 2025Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomy4 Jun 2025