mlsanityData to 7 Oct 2026

What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classification

arXiv 2607.17952 ↗First posted 20 Jul 2026cs.CL cs.CEcited by 0

Not on the map. Why?

Abstract (arXiv)

Climate disclosure classification is a fundamental task for analysing corporate climate disclosures, yet such disclosures appear in many different sources -- annual reports, press releases, and earnings calls -- that differ in length, purpose, and writing style. Existing evaluations are mostly conducted within a single source, leaving open whether common LLM adaptation strategies remain effective under source shift. We reframe climate disclosure classification as a cross-source adaptation problem and study three widely used adaptation strategies -- definitions, examples, and fine-tuning -- across eleven open- and closed-source LLMs, using two corpora that share the same label space but come from different sources. We find that all strategies bring positive cross-source gains on average, but the strongest in-source strategies are not the strongest cross-source ones: similarity-based retrieval and LoRA fine-tuning gain most in-source but lose most of that advantage under source shift; randomly selected few-shot examples, a weaker in-source baseline, retain their advantage more reliably; definitions transfer most consistently, though only when their granularity matches the target text. Across these strategies, when the source changes, simpler is often safer.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

20 of 36 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  8. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  9. 2020In Search of Lost Domain Generalizationcited by 1,042
  10. 2022A Survey on In-context Learningcited by 717
  11. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  12. 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
8 more
  1. 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 89
  2. 2024Revisiting Demonstration Selection Strategies in In-Context Learningcited by 57
  3. 2023ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targetscited by 16
  4. 2022Environmental Claim Detectioncited by 11
  5. 2023Measuring the Robustness of NLP Models to Domain Shiftscited by 11
  6. 2025Towards Robust ESG Analysis Against Greenwashing Risks: Aspect-Action Analysis with Cross-Category Generalizationcited by 7
  7. 2023Evaluating TCFD Reporting: A New Application of Zero-Shot Analysis to Climate-Related Financial Disclosurescited by 3
  8. 2024Controlling Out-of-Domain Gaps in LLMs for Genre Classification and Generated Text Detectioncited by 3

Built on by

Not cited yet.