mlsanityData to 7 Oct 2026

Climate Finance Bench

arXiv 2505.22752 ↗First posted 28 May 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Climate Finance Bench introduces an open benchmark that targets question-answering over corporate climate disclosures using Large Language Models. We curate 33 recent sustainability reports in English drawn from companies across all 11 GICS sectors and annotate 330 expert-validated question-answer pairs that span pure extraction, numerical reasoning, and logical reasoning. Building on this dataset, we propose a comparison of RAG (retrieval-augmented generation) approaches. We show that the retriever's ability to locate passages that actually contain the answer is the chief performance bottleneck. We further argue for transparent carbon reporting in AI-for-climate applications, highlighting advantages of techniques such as Weight Quantization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

29 of 42 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  8. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  9. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  10. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  11. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  12. 2023BloombergGPT: A Large Language Model for Financecited by 923
17 more
  1. 2019Green AIcited by 620
  2. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  3. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  4. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  5. 2023Augmented Language Models: a Surveycited by 398
  6. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  7. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  8. 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
  9. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
  10. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  11. 2024Language Model Cascades: Token-level uncertainty and beyondcited by 115
  12. 2022Task-aware Retrieval with Instructionscited by 107
  13. 2024Searching for Best Practices in Retrieval-Augmented Generationcited by 83
  14. 2025Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scalingcited by 19
  15. 2024ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosurescited by 12
  16. 2024Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Modelscited by 4
  17. 2025Typed-RAG: Type-Aware Decomposition of Non-Factoid Questions for Retrieval-Augmented Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SustainableQA: A Comprehensive Question Answering Dataset for Corporate Sustainability and EU Taxonomy Reporting
  2. 2025Listen to the Context: Towards Faithful Large Language Models for Retrieval Augmented Generation on Climate Questions
  3. 2025CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation
  4. 2025CarbonChat: Large Language Model-Based Corporate Carbon Emission Analysis and Climate Knowledge Q&A System
  5. 2026Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements
  6. 2025ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge
  7. 2026AfriEconQA: A Benchmark for Quantitative and Temporal Reasoning over World Bank Economic Reports
  8. 2024SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation