mlsanityData to 7 Oct 2026

Synergistic Perception and Generative Recomposition: A Multi-Agent Orchestration for Expert-Level Building Inspection

arXiv 2603.20143 ↗First posted 20 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Building facade defect inspection is fundamental to structural health monitoring and sustainable urban maintenance, yet it remains a formidable challenge due to extreme geometric variability, low contrast against complex backgrounds, and the inherent complexity of composite defects (e.g., cracks co-occurring with spalling). Such characteristics lead to severe pixel imbalance and feature ambiguity, which, coupled with the critical scarcity of high-quality pixel-level annotations, hinder the generalization of existing detection and segmentation models. To address gaps, we propose textitFacadeFixer, a unified multi-agent framework that treats defect perception as a collaborative reasoning task rather than isolated recognition. Specifically,textitFacadeFixer orchestrates specialized agents for detection and segmentation to handle multi-type defect interference, working in tandem with a generative agent to enable semantic recomposition. This process decouples intricate defects from noisy backgrounds and realistically synthesizes them onto diverse clean textures, generating high-fidelity augmented data with precise expert-level masks. To support this, we introduce a comprehensive multi-task dataset covering six primary facade categories with pixel-level annotations. Extensive experiments demonstrate that textitFacadeFixer significantly outperforms state-of-the-art (SOTA) baselines. Specifically, it excels in capturing pixel-level structural anomalies and highlights generative synthesis as a robust solution to data scarcity in infrastructure inspection. Our code and dataset will be made publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

13 of 38 references.

References · 13

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  3. 2025SAM 3: Segment Anything with Conceptscited by 835
  4. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  5. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
  6. 2024RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformercited by 88
  7. 2025Capabilities of GPT-5 on Multimodal Medical Reasoningcited by 35
  8. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
  9. 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake Newscited by 29
  10. 2025SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structurescited by 16
  11. 2024Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructurecited by 7
  12. 2025Modular Task Decomposition and Dynamic Collaboration in Multi-Agent Systems Driven by Large Language Modelscited by 7
1 more
  1. 2025InfraGPT Smart Infrastructure: An End-to-End VLM-Based Framework for Detecting and Managing Urban Defectscited by 3

Built on by

Not cited yet.