mlsanityData to 14 Oct 2026

SustainableQA: A Comprehensive Question Answering Dataset for Corporate Sustainability and EU Taxonomy Reporting

arXiv 2508.03000 ↗First posted 5 Aug 2025cs.IRcited by 5

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory

Abstract (arXiv)

The growing demand for corporate sustainability transparency, particularly under new regulations like the EU Taxonomy, necessitates precise data extraction from large, unstructured corporate reports, a task for which Large Language Models and Retrieval-Augmented Generation (RAG) systems require high-quality, domain-specific question-answering datasets. To address this, we introduce SustainableQA, a novel dataset and a scalable pipeline that generates comprehensive QA pairs from corporate sustainability and annual reports by integrating semantic chunk classification, a hybrid span extraction pipeline, and a specialized table-to-paragraph transformation. To ensure high quality, the generation is followed by a novel automated assessment and refinement pipeline that systematically validates each QA pair for faithfulness and relevance, repairing or discarding low-quality entries. This results in a final, robust dataset of over 195,000 diverse factoid and non-factoid QA pairs, whose effectiveness is demonstrated by initial fine-tuning experiments where a compact 8B parameter model outperforms much larger state-of-the-art models. These results demonstrate the potential of SustainableQA as a resource for developing and benchmarking advanced knowledge assistants capable of navigating complex sustainability compliance data

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 69 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

19 of 69 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosures14 Jun

Other references · 18

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2025Gemma 3 Technical Reportcited by 1,824
  6. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  7. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  8. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  9. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  10. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
  11. 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
  12. 2024Improving Retrieval for RAG based Question Answering Models on Financial Documentscited by 49
6 more
  1. 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
  2. 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 29
  3. 2023ESGReveal: An LLM-based approach for extracting structured data from ESG reportscited by 15
  4. 2025ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledgecited by 8
  5. 2024SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generationcited by 7
  6. 2025Optimizing Large Language Models for ESG Activity Detection in Financial Textscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Climate Finance Bench
  2. 2025CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation
  3. 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation
  4. 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models
  5. 2025LLMs to Support a Domain Specific Knowledge Assistant
  6. 2026Advancing ESG Intelligence: An Expert-level Agent and Comprehensive Benchmark for Sustainable Finance
  7. 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes
  8. 2024Aggregated Knowledge Model: Enhancing Domain-Specific QA with Fine-Tuned and Retrieval-Augmented Generation Models