mlsanityData to 7 Oct 2026

An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla

arXiv 2406.17375 ↗First posted 25 Jun 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Pretrained language models inherently exhibit various social biases, prompting a crucial examination of their social impact across various linguistic contexts due to their widespread usage. Previous studies have provided numerous methods for intrinsic bias measurements, predominantly focused on high-resource languages. In this work, we aim to extend these investigations to Bangla, a low-resource language. Specifically, in this study, we (1) create a dataset for intrinsic gender bias measurement in Bangla, (2) discuss necessary adaptations to apply existing bias measurement methods for Bangla, and (3) examine the impact of context length variation on bias measurement, a factor that has been overlooked in previous studies. Through our experiments, we demonstrate a clear dependency of bias metrics on context length, highlighting the need for nuanced considerations in Bangla bias analysis. We consider our work as a stepping stone for bias measurement in the Bangla Language and make all of our resources publicly available to support future research.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 25 Jun 2024.

Builds on

21 of 27 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  5. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  6. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  8. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  9. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  10. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  11. 2019Measuring Bias in Contextualized Word Representationscited by 275
  12. 2021MuRIL: Multilingual Representations for Indian Languagescited by 177
9 more
  1. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
  2. 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 123
  3. 2020Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translationcited by 53
  4. 2022BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Banglacited by 40
  5. 2021CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairscited by 39
  6. 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
  7. 2020AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddingscited by 20
  8. 2020Evaluating Bias In Dutch Word Embeddingscited by 15
  9. 2022BanglaParaphrase: A High-Quality Bangla Paraphrase Datasetcited by 15

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 1.

4 papers.

  1. 2024Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Biascited by 13
  2. 2024An Empirical Study of Gendered Stereotypes in Emotional Attributes for Bangla in Multilingual Large Language Modelscited by 4
  3. 2025Is Lying Only Sinful in Islam? Exploring Religious Bias in Multilingual Large Language Models Across Major Religionscited by 1
  4. 2024Mitigating Extrinsic Gender Bias for Bangla Classification Taskscited by 0