mlsanityData to 14 Oct 2026

'Finance Wizard' at the FinLLM Challenge Task: Financial Text Summarization

arXiv 2408.03762 ↗First posted 7 Aug 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper presents our participation under the team name `Finance Wizard' in the FinNLP-AgentScen 2024 shared task #2: Financial Text Summarization. It documents our pipeline approach of fine-tuning a foundation model into a task-specific model for Financial Text Summarization. It involves (1) adapting Llama3 8B, a foundation model, to the Finance domain via continued pre-training, (2) multi-task instruction-tuning to further equip the model with more finance-related capabilities, (3) finally fine-tuning the model into a task-specific `expert'. Our model, FinLlama3sum, yielded commendable results, securing the third position in its category with a ROUGE-1 score of 0.521.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

17 of 26 references.

References · 17

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  2. 2023BloombergGPT: A Large Language Model for Financecited by 939
  3. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  4. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
  5. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  6. 2023Large Language Models in Finance: A Surveycited by 226
  7. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  8. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  9. 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
  10. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  11. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
  12. 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
5 more
  1. 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuningcited by 80
  2. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
  3. 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 69
  4. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  5. 2024Large Language Model Adaptation for Financial Sentiment Analysiscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.