mlsanityData to 14 Oct 2026

SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation

arXiv 2412.10906 ↗First posted 14 Dec 2024cs.CL cs.CE cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

The rapid growth of the financial sector and the rising focus on Environmental, Social, and Governance (ESG) considerations highlight the need for advanced NLP tools. However, open-source LLMs proficient in both finance and ESG domains remain scarce. To address this gap, we introduce SusGen-30K, a category-balanced dataset comprising seven financial NLP tasks and ESG report generation, and propose TCFD-Bench, a benchmark for evaluating sustainability report generation. Leveraging this dataset, we developed SusGen-GPT, a suite of models achieving state-of-the-art performance across six adapted and two off-the-shelf tasks, trailing GPT-4 by only 2% despite using 7-8B parameters compared to GPT-4's 1,700B. Based on this, we propose the SusGen system, integrated with Retrieval-Augmented Generation (RAG), to assist in sustainability report generation. This work demonstrates the efficiency of our approach, advancing research in finance and ESG.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 28 of its 48 references that are in the map. First posted on arXiv 14 Dec 2024.

Builds on

28 of 48 references.

References · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  7. 2020Scaling Laws for Neural Language Modelscited by 6,586
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  9. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  10. 2023BloombergGPT: A Large Language Model for Financecited by 939
  11. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  12. 2023The Falcon Series of Open Language Modelscited by 535
16 more
  1. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  2. 2024LoRA Learns Less and Forgets Lesscited by 328
  3. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  4. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  5. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  6. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  7. 2024Common 7B Language Models Already Possess Strong Math Capabilitiescited by 109
  8. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 75
  9. 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 69
  10. 2021Trade the Event: Corporate Events Detection for News-Based Event-Driven Tradingcited by 39
  11. 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
  12. 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
  13. 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18
  14. 2024Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiencycited by 18
  15. 2023ESGReveal: An LLM-based approach for extracting structured data from ESG reportscited by 15
  16. 2024Self-training Large Language Models through Knowledge Detectioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.

  1. 2025ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledgecited by 8
  2. 2025SustainableQA: A Comprehensive Question Answering Dataset for Corporate Sustainability and EU Taxonomy Reportingcited by 5
  3. 2025MMESGBench: Pioneering Multimodal Understanding and Complex Reasoning Benchmark for ESG Taskscited by 4
  4. 2025Balancing Truthfulness and Informativeness with Uncertainty-Aware Instruction Fine-Tuningcited by 3
  5. 2025Enhancing Retrieval for ESGLLM via ESG-CID -- A Disclosure Content Index Finetuning Dataset for Mapping GRI and ESRScited by 2
  6. 2026CSTrader: A Testbed for Language-Grounded Trading in a Community-Driven Virtual Asset Marketcited by 0
  7. 2026Empirical Evaluation of Open-Source Large Language Models for Retrieval-Augmented Generation in ESG Domaincited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Advancing ESG Intelligence: An Expert-level Agent and Comprehensive Benchmark for Sustainable Finance
  2. 2025Automated Analysis of Sustainability Reports: Using Large Language Models for the Extraction and Prediction of EU Taxonomy-Compliant KPIs
  3. 2026Benchmarking Embedding Models for ESG Data ↗
  4. 2026FinForge: Semi-Synthetic Financial Benchmark Generation
  5. 2025Evaluating Large Language Models (LLMs) in Financial NLP: A Comparative Study on Financial Report Analysis
  6. 2025FINCH: Financial Intelligence using Natural language for Contextualized SQL Handling
  7. 2026ESGLens: An LLM-Based RAG Framework for Interactive ESG Report Analysis and Score Prediction
  8. 2024KemenkeuGPT: Leveraging a Large Language Model on Indonesia's Government Financial Data and Regulations to Enhance Decision Making