mlsanityData to 7 Oct 2026

ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targets

arXiv 2310.08096 ↗First posted 12 Oct 2023cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Public and private actors struggle to assess the vast amounts of information about sustainability commitments made by various institutions. To address this problem, we create a novel tool for automatically detecting corporate, national, and regional net zero and reduction targets in three steps. First, we introduce an expert-annotated data set with 3.5K text samples. Second, we train and release ClimateBERT-NetZero, a natural language classifier to detect whether a text contains a net zero or reduction target. Third, we showcase its analysis potential with two use cases: We first demonstrate how ClimateBERT-NetZero can be combined with conventional question-answering (Q&A) models to analyze the ambitions displayed in net zero and reduction targets. Furthermore, we employ the ClimateBERT-NetZero model on quarterly earning call transcripts and outline how communication patterns evolve over time. Our experiments demonstrate promising pathways for extracting and analyzing net zero and emission reduction targets at scale.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 12 Oct 2023.

Builds on

10 of 23 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  9. 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 89
  10. 2020ClimaText: A Dataset for Climate Change Topic Detectioncited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 7; 2025: 5; 2026: 3.

16 papers.

Sort:

By area:

  1. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  2. 2024Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlookcited by 33
  3. 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 32
  4. 2024WeatherQA: Can Multimodal Language Models Reason about Severe Weather?cited by 21
  5. 2024ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosurescited by 12
  6. 2024Explainable Natural Language Processing for Corporate Sustainability Analysiscited by 9
  7. 2025A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptationcited by 5
  8. 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
  9. 2025AIMS.au: A Dataset for the Analysis of Modern Slavery Countermeasures in Corporate Statementscited by 1
  10. 2025Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Modelscited by 1
  11. 2025Climate-Eval: A Comprehensive Benchmark for NLP Tasks Related to Climate Changecited by 1
  12. 2024Identifying Climate Targets in National Laws and Policies using Machine Learningcited by 0
4 more
  1. 2024Climate AI for Corporate Decarbonization Metrics Extractioncited by 0
  2. 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
  3. 2026What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classificationcited by 0
  4. 2026Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretrainingcited by 0