mlsanityData to 14 Oct 2026

IndRegBias: A Dataset for Studying Indian Regional Biases in English and Code-Mixed Social Media Comments

arXiv 2601.06477 ↗First posted 10 Jan 2026cs.CL cs.CY cs.SIcited by 0

Not on the map. Why?

Abstract (arXiv)

Warning: This paper consists of examples representing regional biases in Indian regions that might be offensive towards a particular region. While social biases corresponding to gender, race, socio-economic conditions, etc., have been extensively studied in the major applications of Natural Language Processing (NLP), biases corresponding to regions have garnered less attention. This is mainly because of (i) difficulty in the extraction of regional bias datasets, (ii) disagreements in annotation due to inherent human biases, and (iii) regional biases being studied in combination with other types of social biases and often being under-represented. This paper focuses on creating a dataset IndRegBias, consisting of regional biases in an Indian context reflected in users' comments on popular social media platforms, namely Reddit and YouTube. We carefully selected 25,000 comments appearing on various threads in Reddit and videos on YouTube discussing trending topics on regional issues in India. Furthermore, we propose a multilevel annotation strategy to annotate the comments describing the severity of regional biased statements. To detect the presence of regional bias and its severity in IndRegBias, we evaluate open-source Large Language Models (LLMs) and Indic Language Models (ILMs) using zero-shot, few-shot, and fine-tuning strategies. We observe that zero-shot and few-shot approaches show lower accuracy in detecting regional biases and severity in the majority of the LLMs and ILMs. However, the fine-tuning approach significantly enhances the performance of the LLM in detecting Indian regional bias along with its severity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 10 Jan 2026.

Builds on

19 of 44 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  8. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  9. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  10. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  11. 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
  12. 2019Gender Bias in Contextualized Word Embeddingscited by 203
7 more
  1. 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
  2. 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 56
  3. 2022Re-contextualizing Fairness in NLP: The Case of Indiacited by 55
  4. 2024Airavata: Introducing Hindi Instruction-tuned LLMcited by 32
  5. 2022Geographic and Geopolitical Biases of Language Modelscited by 29
  6. 2025Krutrim LLM: Multilingual Foundational Model for over a Billion Peoplecited by 10
  7. 2025BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responsescited by 2

Built on by

Not cited yet.