mlsanityData to 14 Oct 2026

Trust-Aware Multi-Agent Traceability: Confidence-Calibrated Knowledge Graphs for Consistent Software Artifact Management

arXiv 2606.17203 ↗First posted 15 Jun 2026cs.SE cs.AIcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Multi-agent AI systems are increasingly used to automate software engineering tasks including requirements analysis, architecture design, test generation, and traceability linking. When these agents operate as a sequential pipeline over shared software artifacts, errors and low-confidence decisions made by upstream agents propagate to downstream stages, producing orphaned requirements, contradictory links, and compliance gaps that pose significant risks in safety-critical domains. We propose a trust-aware coordination framework where a shared knowledge graph serves as both centralized semantic memory and a coordination surface through which agents assess and build upon each other's contributions using calibrated confidence scores. Our approach introduces a two-stage traceability link prediction pipeline combining embedding-based retrieval with LLM-based multi-criteria analysis, a traceability seeding mechanism that enables comparison between derivation-time and validation-time confidence, and a consistency protocol governing pipeline interactions through confidence threshold gating, confidence divergence detection, and conflict resolution. We evaluate on an automotive software engineering case study measuring link prediction calibration, protocol effectiveness, threshold sensitivity, and the impact of traceability seeding. Ablation studies confirm that confidence calibration is essential for effective pipeline coordination.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 25 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

13 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 12

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  4. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  5. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  6. 2023Large Language Models for Software Engineering: Survey and Open Problemscited by 181
  7. 2025KARMA: Leveraging Multi-Agent LLMs for Automated Knowledge Graph Enrichmentcited by 27
  8. 2018Semantically Enhanced Software Traceability Using Deep Learning Techniquescited by 22
  9. 2021Traceability Transformed: Generating more Accurate Links with Pre-Trained BERT Modelscited by 20
  10. 2023Prompts Matter: Insights and Strategies for Prompt Engineering in Automated Software Traceabilitycited by 15
  11. 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbotscited by 10
  12. 2025Who's Who? LLM-assisted Software Traceability with Architecture Entity Recognitioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TraceDev: A Traceability-Driven Multi-agent Framework for Requirement-to-Code Development
  2. 2026CCCE: A Continuous Code Calibration Engine for Autonomous Enterprise Codebase Maintenance via Knowledge Graph Traversal and Adaptive Decision Gating
  3. 2026Knowledge-Based Pull Requests: A Trusted Workflow for Agent-Mediated Knowledge Collaboration
  4. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
  5. 2026AgentAudit: An Open, Extensible Framework for Full-Lifecycle Trust Evaluation of AI Agents
  6. 2026From Traceability to Justifiability: Accountability Structures in Agentic Software Engineering
  7. 2026Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents
  8. 2026UA-ChatDev: Uncertainty-Aware Multi-Agent Collaboration for Reliable Software Development