mlsanityData to 7 Oct 2026

Towards Answering Climate Questionnaires from Unstructured Climate Reports

arXiv 2301.04253 ↗First posted 11 Jan 2023cs.CL cs.AI cs.IRcited by 9

Not on the map. Why?

Abstract (arXiv)

The topic of Climate Change (CC) has received limited attention in NLP despite its urgency. Activists and policymakers need NLP tools to effectively process the vast and rapidly growing unstructured textual climate reports into structured form. To tackle this challenge we introduce two new large-scale climate questionnaire datasets and use their existing structure to train self-supervised models. We conduct experiments to show that these models can learn to generalize to climate disclosures of different organizations types than seen during training. We then use these models to help align texts from unstructured climate documents to the semi-structured questionnaires in a human pilot study. Finally, to support further NLP research in the climate domain we introduce a benchmark of existing climate text classification datasets to better evaluate and compare existing models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 11 Jan 2023.

Builds on

21 of 48 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  9. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  10. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  11. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  12. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
9 more
  1. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  2. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
  3. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  4. 2019Tackling Climate Change with Machine Learningcited by 264
  5. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
  6. 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 89
  7. 2020ClimaText: A Dataset for Climate Change Topic Detectioncited by 22
  8. 2020Analyzing Sustainability Reports Using Natural Language Processingcited by 18
  9. 2021NLP for Climate Policy: Creating a Knowledge Platform for Holistic and Effective Climate Actioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 2.

9 papers.