"So There's a Catch-22 Here": How Early Adopters Who Build Multi-Agent LLM Systems Conceptualize Transparency
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent large language model (LLM) systems are rapidly emerging, yet transparency, a cornerstone of responsible AI, remains under-defined in these distributed architectures, which have complexities of inter-agent coordination and orchestration. In this paper, we present one of the first empirical study of how early adopters of multi-agent LLM systems, who are both the builders and users, understand and practice transparency. We conducted semi-structured interviews with 13 early adopters in [Large Technology Organization] and applied thematic analysis to identify recurring patterns. Participants articulated divergent yet complementary framings of transparency, including reproducibility, debugging, boundary-setting, visualization, and auditing. These perspectives spanned questions of what transparency entails, why it matters, and how it is achieved. We synthesize these into a multidimensional framework, which is developer, user, and governance-focused positioning transparency as a situated socio-technical practice that informs future HCI and AI design and research around aligning expectations and capacities of their intended audiences.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 7 of its 31 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
7 of 31 references.
References · 7
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,945
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 381
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 258
- 2024Design Principles for Generative AI Applicationscited by 57
- 2024Determinants of LLM-assisted Decision-Makingcited by 55
- 2023Investigating and Designing for Trust in AI-powered Code Generation Toolscited by 34
- 2023Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experiencecited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fairness in Multi-Agent Systems for Software Engineering: An SDLC-Oriented Rapid Review
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI
- 2026Multi-User Large Language Model Agents
- 2025Position: The Real Barrier to LLM Agent Usability is Agentic ROI
- 2026LLM-FACETS: A Privacy-Preserving Framework for Evaluating LLM Transparency and Accountability
- 2026AgentLeak: A Benchmark for Internal-Channel Privacy Leakage in Multi-Agent LLM Systems
- 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
- 2026A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents