mlsanityData to 7 Oct 2026

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias

arXiv 2407.03536 ↗First posted 3 Jul 2024cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

The rapid growth of Large Language Models (LLMs) has put forward the study of biases as a crucial field. It is important to assess the influence of different types of biases embedded in LLMs to ensure fair use in sensitive fields. Although there have been extensive works on bias assessment in English, such efforts are rare and scarce for a major language like Bangla. In this work, we examine two types of social biases in LLM generated outputs for Bangla language. Our main contributions in this work are: (1) bias studies on two different social biases for Bangla, (2) a curated dataset for bias measurement benchmarking and (3) testing two different probing techniques for bias detection in the context of Bangla. This is the first work of such kind involving bias assessment of LLMs for Bangla to the best of our knowledge. All our code and resources are publicly available for the progress of bias related research in Bangla NLP.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

34 of 46 references.

References · 34

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  3. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  4. 2021Ethical and social risks of harm from Language Modelscited by 957
  5. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  6. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  8. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  9. 2014Certifying and removing disparate impactcited by 715
  10. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  11. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  12. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
22 more
  1. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
  2. 2018Gender Bias in Coreference Resolutioncited by 438
  3. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  4. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  5. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  6. 2023Self-collaboration Code Generation via ChatGPTcited by 255
  7. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
  8. 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 123
  9. 2021A Survey on Gender Bias in Natural Language Processingcited by 89
  10. 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
  11. 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypescited by 58
  12. 2024Disclosure and Mitigation of Gender Bias in LLMscited by 47
  13. 2022Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversalcited by 40
  14. 2021CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairscited by 39
  15. 2024Gender Bias in Large Language Models across Multiple Languagescited by 35
  16. 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inferencecited by 32
  17. 2023A Trip Towards Fairness: Bias and De-Biasing in Large Language Modelscited by 32
  18. 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
  19. 2023On Evaluating and Mitigating Gender Biases in Multilingual Settingscited by 31
  20. 2022BanglaParaphrase: A High-Quality Bangla Paraphrase Datasetcited by 15
  21. 2022An Analysis of Social Biases Present in BERT Variants Across Multiple Languagescited by 6
  22. 2024An Empirical Study on the Characteristics of Bias upon Context Length Variation for Banglacited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 5.

13 papers.

Sort:

By area:

  1. 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religioncited by 14
  2. 2026Cross-Lingual Sentiment Misalignment: Auditing Multilingual Language Models for Inversion Risk, Dialectal Representation, and Affective Stabilitycited by 5
  3. 2024An Empirical Study of Gendered Stereotypes in Emotional Attributes for Bangla in Multilingual Large Language Modelscited by 4
  4. 2025Mind the Language Gap: Automated and Augmented Evaluation of Bias in LLMs for High- and Low-Resource Languagescited by 4
  5. 2024BanStereoSet: A Dataset to Measure Stereotypical Social Biases in LLMs for Banglacited by 3
  6. 2025Purdah and Patriarchy: Evaluating and Mitigating South Asian Biases in Open-Ended Multilingual LLM Generationscited by 2
  7. 2025Is Lying Only Sinful in Islam? Exploring Religious Bias in Multilingual Large Language Models Across Major Religionscited by 1
  8. 2026Redirected, Not Removed: Task-Dependent Stereotyping Reveals the Limits of LLM Alignmentscited by 1
  9. 2024Mitigating Extrinsic Gender Bias for Bangla Classification Taskscited by 0
  10. 2025How do datasets, developers, and models affect biases in a low-resourced language?: The Case of the Bengali Languagecited by 0
  11. 2026Are LLMs Ready to Replace Bangla Annotators?cited by 0
  12. 2026Benchmarking Bengali Dialectal Bias: A Multi-Stage Framework Integrating RAG-Based Translation and Human-Augmented RLAIFcited by 0
1 more
  1. 2026Some Dialects Are More Equal Than Others: Non-Prestigious Arabic Dialectal Bias in LLMscited by 0