Fairness in Multi-Agent Systems for Software Engineering: An SDLC-Oriented Rapid Review
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Transformer-based large language models (LLMs) and multi-agent systems (MAS) are increasingly embedded across the software development lifecycle (SDLC), yet their fairness implications for developer-facing tools remain underexplored despite their growing role in shaping what code is written, reviewed, and released. We present a rapid review of recent work on fairness in MAS, emphasizing LLM-enabled settings and relevance to software engineering. Starting from an initial set of 350 papers, we screened and filtered the corpus for relevance, retaining 18 studies for final analysis. Across these 18 studies, fairness is framed as a combination of trustworthy AI principles, bias reduction across groups, and interactional dynamics in collectives, while evaluation spans accuracy metrics on bias benchmarks, demographic disparity measures, and emergent MAS-specific notions such as conformity and bias amplification. Reported harms include representational, quality-of-service, security and privacy, and governance failures, which we relate to SDLC stages where evidence is most and least developed. We identify three persistent gaps: (1) fragmented, rarely MAS-specific evaluation practices that limit comparability, (2) limited generalization due to simplified environments and narrow attribute coverage, and (3) scarce, weakly evaluated mitigation and governance mechanisms aligned to real software workflows. These findings suggest MAS fairness research is not yet ready to support deployable, fairness-assured software systems, motivating MAS-aware benchmarks, consistent protocols, and lifecycle-spanning governance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 27 of its 65 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
27 of 65 references.
Closest ancestors · 6
Same direction, newest first
- 2025Multi-Agent Code-Orchestrated Generation for Reliable Infrastructure-as-Code4 Oct
- 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmap7 Sep
- 2025Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Models8 Jul
- 2025Facilitating Trustworthy Human-Agent Collaboration in LLM-based Multi-Agent System oriented Software Engineering7 May
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 21
- 2017Attention Is All You Needcited by 59,932
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2023Gender bias and stereotypes in Large Language Modelscited by 185
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 58
- 2023Bias Testing and Mitigation in LLM-based Code Generationcited by 53
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactionscited by 50
- 2024AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodologycited by 45
- 2024Towards AI-Native Software Engineering (SE 3.0): A Vision and a Challenge Roadmapcited by 30
- 2023Uncovering and Quantifying Social Biases in Code Generationcited by 25
9 more
- 2024Bias Unveiled: Investigating Social Bias in LLM-Generated Codecited by 25
- 2025A Survey of LLM-based Automated Program Repair: Taxonomies, Design Paradigms, and Applicationscited by 24
- 2025Unmasking Conversational Bias in AI Multiagent Systemscited by 16
- 2024Mitigating Social Bias in Large Language Models: A Multi-Objective Approach within a Multi-Agent Frameworkcited by 8
- 2025An Empirical Study of Group Conformity in Multi-Agent Systemscited by 7
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AIcited by 6
- 2020Rapid Reviews in Software Engineeringcited by 5
- 2025Analyzing 16,193 LLM Papers for Fun and Profitscited by 3
- 2025Revealing Political Bias in LLMs through Structured Multi-Agent Debatecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Based Agentic Systems for Software Engineering: Challenges and Opportunities
- 2026Social Bias in LLM-Generated Code: Benchmark and Mitigation
- 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report
- 2025Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale
- 2026"So There's a Catch-22 Here": How Early Adopters Who Build Multi-Agent LLM Systems Conceptualize Transparency
- 2024Large Language Model-Based Agents for Software Engineering: A Survey
- 2025SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models
- 2026Reliable and Developer-Aligned Evaluation of Agents for Software Engineering