mlsanityData to 14 Oct 2026

Debiasing Large Language Models in Thai Political Stance Detection via Counterfactual Calibration

arXiv 2509.21946 ↗First posted 26 Sep 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Political stance detection in low-resource and culturally complex settings poses a critical challenge for large language models (LLMs). In the Thai political landscape - marked by indirect language, polarized figures, and entangled sentiment and stance - LLMs often display systematic biases such as sentiment leakage and favoritism toward entities. These biases undermine fairness and reliability. We present ThaiFACTUAL, a lightweight, model-agnostic calibration framework that mitigates political bias without requiring fine-tuning. ThaiFACTUAL uses counterfactual data augmentation and rationale-based supervision to disentangle sentiment from stance and reduce bias. We also release the first high-quality Thai political stance dataset, annotated with stance, sentiment, rationales, and bias markers across diverse entities and events. Experimental results show that ThaiFACTUAL significantly reduces spurious correlations, enhances zero-shot generalization, and improves fairness across multiple LLMs. This work highlights the importance of culturally grounded debiasing techniques for underrepresented languages.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

11 of 20 references.

References · 11

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  3. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  4. 2023Explore Spurious Correlations at the Concept Level in Language Models for Text Classificationcited by 48
  5. 2020X-Stance: A Multilingual Multi-Target Dataset for Stance Detectioncited by 43
  6. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  7. 2023Debiasing Algorithm through Model Adaptationcited by 24
  8. 2023Understanding the Effect of Model Compression on Social Bias in Large Language Modelscited by 19
  9. 2023Co2PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuningcited by 15
  10. 2022Debiasing Stance Detection Models with Counterfactual Reasoning and Adversarial Bias Learningcited by 5
  11. 2023Inducing Political Bias Allows Language Models Anticipate Partisan Reactions to Controversiescited by 4

Built on by

Not cited yet.