mlsanityData to 14 Oct 2026

Auto-Search and Refinement: An Automated Framework for Gender Bias Mitigation in Large Language Models

arXiv 2502.11559 ↗First posted 17 Feb 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Pre-training large language models (LLMs) on vast text corpora enhances natural language processing capabilities but risks encoding social biases, particularly gender bias. While parameter-modification methods like fine-tuning mitigate bias, they are resource-intensive, unsuitable for closed-source models, and lack adaptability to evolving societal norms. Instruction-based approaches offer flexibility but often compromise task performance. To address these limitations, we propose FaIRMaker, an automated and model-independent framework that employs an auto-search and refinement paradigm to adaptively generate Fairwords, which act as instructions integrated into input queries to reduce gender bias and enhance response quality. Extensive experiments demonstrate that FaIRMaker automatically searches for and dynamically refines Fairwords, effectively mitigating gender bias while preserving task integrity and ensuring compatibility with both API-based and open-source LLMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 17 Feb 2025.

Builds on

45 of 59 references.

References · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  8. 2024Qwen2.5 Technical Reportcited by 4,942
  9. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  10. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  11. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  12. 2023A Survey of Large Language Modelscited by 2,576
33 more
  1. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  2. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  3. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  4. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  5. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  6. 2019On Measuring Social Biases in Sentence Encoderscited by 398
  7. 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
  8. 2023PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimizationcited by 316
  9. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
  10. 2019Measuring Bias in Contextualized Word Representationscited by 276
  11. 2022Prompting GPT-3 To Be Reliablecited by 260
  12. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  13. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 199
  14. 2023Gender bias and stereotypes in Large Language Modelscited by 187
  15. 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
  16. 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 172
  17. 2023Black-Box Prompt Optimization: Aligning Large Language Models without Model Trainingcited by 122
  18. 2020Towards Controllable Biases in Language Generationcited by 112
  19. 2023A Survey on Fairness in Large Language Modelscited by 95
  20. 2021Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translationcited by 62
  21. 2024Disclosure and Mitigation of Gender Bias in LLMscited by 49
  22. 2023Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventionscited by 28
  23. 2023Fairness-Aware Structured Pruning in Transformerscited by 22
  24. 2024GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Modelscited by 18
  25. 2024BiasDPO: Mitigating Bias in Language Models through Direct Preference Optimizationcited by 18
  26. 2024MBIAS: Mitigating Bias in Large Language Models While Retaining Contextcited by 15
  27. 2024From 'Showgirls' to 'Performers': Fine-tuning with Gender-inclusive Language for Bias Reduction in LLMscited by 15
  28. 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
  29. 2023In-Contextual Gender Bias Suppression for Large Language Modelscited by 12
  30. 2024Locating and Mitigating Gender Bias in Large Language Modelscited by 12
  31. 2024The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMscited by 12
  32. 2024Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputscited by 11
  33. 2024Different Bias Under Different Criteria: Assessing Bias in LLMs with a Fact-Based Approachcited by 3

Built on by

Not cited yet.