mlsanityData to 14 Oct 2026

Comparing BERT Sentence-Pair Classification and Few-Shot LLM Prompting for Detecting Threat and Solution Framing in German Climate News

arXiv 2606.26489 ↗First posted 25 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

News media play a central role in shaping public perceptions of climate change, and whether coverage emphasizes threats or solutions has measurable effects on audience engagement and policy support. Automated detection of these framing patterns at the sentence level would allow researchers to analyze large corpora that are infeasible to code manually. We present a systematic comparison of two approaches for classifying sentences from German-language climate news articles as threat-oriented, solution-oriented, both, or neither. The first approach uses few-shot prompting with an open-weights large language model (Llama 4 Maverick), employing chain-of-thought reasoning and structured output with confidence scoring. The second approach fine-tunes a German BERT model (deepset/gbert-large) for sentence-pair classification, where the preceding sentence provides contextual information for the target sentence. Both approaches implement two independent binary classifiers, one for threat framing and one for solution framing. We evaluate both methods on a corpus of 440 Austrian newspaper articles that were manually coded following a detailed coding scheme developed with domain experts. The fine-tuned BERT classifiers achieve an F1 score of 0.83 for both the threat and solution tasks, while the LLM-based classifiers reach an F1 of 0.78. An ablation study confirms that providing the preceding sentence as context improves BERT classification performance substantially compared to single-sentence input. These results contribute to the growing body of work comparing fine-tuned encoder models with prompted generative models for text classification in computational social science.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 50 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

17 of 50 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  7. 2023Can Large Language Models Transform Computational Social Science?cited by 250
  8. 2020German's Next Language Modelcited by 144
  9. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  10. 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
  11. 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 90
  12. 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 70
5 more
  1. 2019Pretrained Language Models for Sequential Sentence Classificationcited by 53
  2. 2024Language Models for Text Classification: Is In-Context Learning Enough?cited by 40
  3. 2023Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuningcited by 32
  4. 2020Exploring Cross-sentence Contexts for Named Entity Recognition with BERTcited by 27
  5. 2025Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMscited by 22

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CienaLLM: Generative Climate-Impact Extraction from News Articles with Autoregressive LLMs
  2. 2024Efficient Aspect-Based Summarization of Climate Change Reports with Small Language Models
  3. 2026From Codebooks to VLMs: Evaluating Automated Visual Discourse Analysis for Climate Change on Social Media
  4. 2024Deciphering Political Entity Sentiment in News with Large Language Models: Zero-Shot and Few-Shot Strategies
  5. 2025CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ)
  6. 2021The Power of Language: Understanding Sentiment Towards the Climate Emergency using Twitter Data
  7. 2024Unlearning Climate Misinformation in Large Language Models
  8. 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analytics