'Finance Wizard' at the FinLLM Challenge Task: Financial Text Summarization
Not on the map. Why?
Abstract (arXiv)
This paper presents our participation under the team name `Finance Wizard' in the FinNLP-AgentScen 2024 shared task #2: Financial Text Summarization. It documents our pipeline approach of fine-tuning a foundation model into a task-specific model for Financial Text Summarization. It involves (1) adapting Llama3 8B, a foundation model, to the Finance domain via continued pre-training, (2) multi-task instruction-tuning to further equip the model with more finance-related capabilities, (3) finally fine-tuning the model into a task-specific `expert'. Our model, FinLlama3sum, yielded commendable results, securing the third position in its category with a ROUGE-1 score of 0.521.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
17 of 26 references.
References · 17
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2023Large Language Models in Finance: A Surveycited by 226
- 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
- 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
- 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
5 more
- 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuningcited by 80
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
- 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 69
- 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
- 2024Large Language Model Adaptation for Financial Sentiment Analysiscited by 18
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2026SoK: Security of Autonomous LLM Agents in Agentic Commercecited by 8
- 2024Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesiacited by 4
- 2025HARLF: Hierarchical Reinforcement Learning and Lightweight LLM-Driven Sentiment Integration for Financial Portfolio Optimizationcited by 2
- 2025Synthesizing Behaviorally-Grounded Reasoning Chains: A Data-Generation Framework for Personal Finance LLMscited by 1
- 2026SoK: Security of Autonomous LLM Agents in Agentic Commerce15 Apr 2026
- 2025Synthesizing Behaviorally-Grounded Reasoning Chains: A Data-Generation Framework for Personal Finance LLMs17 Sep 2025
- 2025HARLF: Hierarchical Reinforcement Learning and Lightweight LLM-Driven Sentiment Integration for Financial Portfolio Optimization24 Jul 2025
- 2024Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia13 Sep 2024