mlsanityData to 7 Oct 2026

Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairness

arXiv 2603.07368 ↗First posted 7 Mar 2026cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Biases in large language models (LLMs) often manifest as systematic distortions in associations between demographic attributes and professional or social roles, reinforcing harmful stereotypes across gender, ethnicity, and geography. This position paper advocates for addressing demographic and gender biases in LLMs through a dual-pronged methodology, integrating category-theoretic transformations and retrieval-augmented generation (RAG). Category theory provides a rigorous, structure-preserving mathematical framework that maps biased semantic domains to unbiased canonical forms via functors, ensuring bias elimination while preserving semantic integrity. Complementing this, RAG dynamically injects diverse, up-to-date external knowledge during inference, directly countering ingrained biases within model parameters. By combining structural debiasing through functor-based mappings and contextual grounding via RAG, we outline a comprehensive framework capable of delivering equitable and fair model outputs. Our synthesis of the current literature validates the efficacy of each approach individually, while addressing potential critiques demonstrates the robustness of this integrated strategy. Ensuring fairness in LLMs, therefore, demands both the mathematical rigor of category-theoretic transformations and the adaptability of retrieval augmentation.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 69 of its 104 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

69 of 104 references.

References · 69

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  9. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  10. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  11. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  12. 2019The Curious Case of Neural Text Degenerationcited by 2,881
38 more
  1. 2017Billion-scale similarity search with GPUscited by 2,477
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  3. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  4. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  5. 2016Concrete Problems in AI Safetycited by 1,582
  6. 2018Datasheets for Datasetscited by 1,371
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  9. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  10. 2018Model Cards for Model Reportingcited by 1,068
  11. 2021Ethical and social risks of harm from Language Modelscited by 957
  12. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  13. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  14. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  15. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  16. 2017Counterfactual Fairnesscited by 802
  17. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  18. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  19. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  20. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  21. 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
  22. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  23. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  24. 2018A Reductions Approach to Fair Classificationcited by 585
  25. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  26. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
  27. 2023Augmented Language Models: a Surveycited by 398
  28. 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
  29. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
  30. 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
  31. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  32. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 251
  33. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
  34. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  35. 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 174
  36. 2020Towards Debiasing Sentence Representationscited by 170
  37. 2018Learning Gender-Neutral Word Embeddingscited by 169
  38. 2018Adversarial Removal of Demographic Attributes from Text Datacited by 166

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Social Bias in RAG Systems: When External Context Helps and Reasoning Hurts
  2. 2024With a Grain of SALT: Are LLMs Fair Across Social Dimensions?
  3. 2023Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications
  4. 2025Robustly Improving LLM Fairness in Realistic Settings via Interpretability
  5. 2026Intra-Fairness Dynamics: The Bias Spillover Effect in Targeted LLM Alignment
  6. 2024A Multi-LLM Debiasing Framework
  7. 2026DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation
  8. 2025Mitigating Bias in RAG: Controlling the Embedder