SustainableQA: A Comprehensive Question Answering Dataset for Corporate Sustainability and EU Taxonomy Reporting
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
Abstract (arXiv)
The growing demand for corporate sustainability transparency, particularly under new regulations like the EU Taxonomy, necessitates precise data extraction from large, unstructured corporate reports, a task for which Large Language Models and Retrieval-Augmented Generation (RAG) systems require high-quality, domain-specific question-answering datasets. To address this, we introduce SustainableQA, a novel dataset and a scalable pipeline that generates comprehensive QA pairs from corporate sustainability and annual reports by integrating semantic chunk classification, a hybrid span extraction pipeline, and a specialized table-to-paragraph transformation. To ensure high quality, the generation is followed by a novel automated assessment and refinement pipeline that systematically validates each QA pair for faithfulness and relevance, repairing or discarding low-quality entries. This results in a final, robust dataset of over 195,000 diverse factoid and non-factoid QA pairs, whose effectiveness is demonstrated by initial fine-tuning experiments where a compact 8B parameter model outperforms much larger state-of-the-art models. These results demonstrate the potential of SustainableQA as a resource for developing and benchmarking advanced knowledge assistants capable of navigating complex sustainability compliance data
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 69 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
19 of 69 references.
Closest ancestors · 1
Same direction, newest first
- 2024ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosures14 Jun
Other references · 18
- 2025Qwen3 Technical Reportcited by 8,820
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2025Gemma 3 Technical Reportcited by 1,824
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
- 2024Improving Retrieval for RAG based Question Answering Models on Financial Documentscited by 49
6 more
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
- 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 29
- 2023ESGReveal: An LLM-based approach for extracting structured data from ESG reportscited by 15
- 2025ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledgecited by 8
- 2024SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generationcited by 7
- 2025Optimizing Large Language Models for ESG Activity Detection in Financial Textscited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026TEMPO: A Realistic Multi-Domain Benchmark for Temporal Reasoning-Intensive Retrievalcited by 6
- 2026Doc-PP: Document Policy Preservation Benchmark for Large Vision-Language Modelscited by 1
- 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answeringcited by 1
- 2026HIVE: Query, Hypothesize, Verify An LLM Framework for Multimodal Reasoning-Intensive Retrievalcited by 0
- 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extractioncited by 0
- 2026Citation-Closure Retrieval and Per-Rule Attribution for Real-World Regulatory Compliance Question Answering28 May 2026
- 2026REGREACT: Self-Correcting Multi-Agent Pipelines for Structured Regulatory Information Extraction13 Apr 2026
- 2026HIVE: Query, Hypothesize, Verify An LLM Framework for Multimodal Reasoning-Intensive Retrieval8 Apr 2026
- 2026TEMPO: A Realistic Multi-Domain Benchmark for Temporal Reasoning-Intensive Retrieval14 Jan 2026
- 2026Doc-PP: Document Policy Preservation Benchmark for Large Vision-Language Models7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Climate Finance Bench
- 2025CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation
- 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models
- 2025LLMs to Support a Domain Specific Knowledge Assistant
- 2026Advancing ESG Intelligence: An Expert-level Agent and Comprehensive Benchmark for Sustainable Finance
- 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes
- 2024Aggregated Knowledge Model: Enhancing Domain-Specific QA with Fine-Tuned and Retrieval-Augmented Generation Models