Towards Answering Climate Questionnaires from Unstructured Climate Reports
Not on the map. Why?
Abstract (arXiv)
The topic of Climate Change (CC) has received limited attention in NLP despite its urgency. Activists and policymakers need NLP tools to effectively process the vast and rapidly growing unstructured textual climate reports into structured form. To tackle this challenge we introduce two new large-scale climate questionnaire datasets and use their existing structure to train self-supervised models. We conduct experiments to show that these models can learn to generalize to climate disclosures of different organizations types than seen during training. We then use these models to help align texts from unstructured climate documents to the semi-structured questionnaires in a human pilot study. Finally, to support further NLP research in the climate domain we introduce a benchmark of existing climate text classification datasets to better evaluate and compare existing models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
21 of 48 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
9 more
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2019Tackling Climate Change with Machine Learningcited by 264
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
- 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 89
- 2020ClimaText: A Dataset for Climate Change Topic Detectioncited by 22
- 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18
- 2021NLP for Climate Policy: Creating a Knowledge Platform for Holistic and Effective Climate Actioncited by 3
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 2.
9 papers.
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 21
- 2024Learning to Rewrite: Generalized LLM-Generated Text Detectioncited by 13
- 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptationcited by 5
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibrationcited by 5
- 2025Climate-Eval: A Comprehensive Benchmark for NLP Tasks Related to Climate Changecited by 1
- 2024Identifying Climate Targets in National Laws and Policies using Machine Learningcited by 0
- 2024Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Designcited by 0
- 2026A Distribution-Free Framework for Rewrite-Based Human-text Detection via Knockoff Filteringcited by 0
- 2026Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretrainingcited by 0
- 2026Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretraining7 Sep 2026
- 2026A Distribution-Free Framework for Rewrite-Based Human-text Detection via Knockoff Filtering29 May 2026
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibration20 Aug 2025
- 2025Climate-Eval: A Comprehensive Benchmark for NLP Tasks Related to Climate Change24 May 2025
- 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation24 Apr 2025
- 2024Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Design9 Dec 2024
- 2024Learning to Rewrite: Generalized LLM-Generated Text Detection8 Aug 2024
- 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?17 Jun 2024
- 2024Identifying Climate Targets in National Laws and Policies using Machine Learning3 Apr 2024