FairReason: Balancing Reasoning and Social Bias in MLLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) already achieve state-of-the-art results across a wide range of tasks and modalities. To push their reasoning ability further, recent studies explore advanced prompting schemes and post-training fine-tuning. Although these techniques improve logical accuracy, they frequently leave the models' outputs burdened with pronounced social biases. Clarifying how reasoning gains interact with bias mitigation-and whether the two objectives inherently trade off-therefore remains an open and pressing research problem. Our study begins by benchmarking three bias-mitigation strategies-supervised fine-uning (SFT), knowledge distillation (KD), and rule-based reinforcement learning (RL)-under identical conditions, establishing their baseline strengths and weaknesses. Building on these results, we vary the proportion of debias-focused and reasoning-centric samples within each paradigm to chart the reasoning-versus-bias trade-off. Our sweeps reveal a consistent sweet spot: a roughly 1:4 mix trained with reinforcement learning cuts stereotype scores by 10% while retaining 88% of the model's original reasoning accuracy, offering concrete guidance for balancing fairness and capability in MLLMs.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 31 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
9 of 31 references.
References · 9
- 2023Let's Verify Step by Stepcited by 3,789
- 2024MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Modelscited by 53
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
- 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
- 2024Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Modelscited by 27
- 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 27
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Modelcited by 26
- 2024Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Actioncited by 19
- 2024Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion?cited by 18
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning
- 2025Is Reasoning All You Need? Probing Bias in the Age of Reasoning Language Models
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
- 2025BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning
- 2025Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoning
- 2024Social Debiasing for Fair Multi-modal LLMs