mlsanityData to 14 Oct 2026

CoRe-SAM3: Conditional Semantic--Visual Reconciliation for SAM3 Crack Segmentation

arXiv 2609.05816 ↗First posted 5 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Crack segmentation requires a model to recognize target semantics while accurately recovering thin, low-contrast, and topologically continuous local structures. Although SAM3 provides strong open-concept segmentation, its direct application to the crack domain still misses weak cracks, activates crack-like background regions, and produces local boundary errors. We first diagnose the functional differences between the internal prompt-conditioned semantic representation and native visual representation of SAM3 on five crack datasets. The results show that the semantic representation already carries most task information for crack prediction, whereas the utility of the visual representation depends on the current semantic state. Directly combining the two representations does not yield consistent gains. Based on this finding, we propose Conditional Semantic--Visual Reconciliation, termed CoRe. CoRe retains semantic prediction as the primary decision path, applies lightweight semantic calibration to adjust the target-domain decision mapping, and uses spatially aligned native visual evidence to generate a zero-initialized, bounded, and regularized conditional residual that selectively corrects existing predictions. Across five domains, CoRe-SAM3 improves the average Crack IoU from 62.34% to 70.47% and clDice from 81.98% to 89.24%, while introducing only 18.914 K trainable parameters. Prediction-transition analysis further shows that CoRe corrects an average of 34.38% of native errors, with a damage rate of only 0.23% on pixels correctly classified by native SAM3. These results demonstrate that constrained prediction correction based on the functional differences between internal representations provides an effective and parameter-efficient target-domain adaptation strategy for vision foundation models with strong task-specific semantic priors.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 5 Sep 2026.

Builds on

22 of 40 references.

References · 22

  1. 2023Segment Anythingcited by 8,234
  2. 2022Visual Prompt Tuningcited by 1,681
  3. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
  4. 2023Segment Everything Everywhere All at Oncecited by 548
  5. 2023Segment Anything in High Qualitycited by 376
  6. 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 294
  7. 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 294
  8. 2023Personalize Segment Anything Model with One Shotcited by 250
  9. 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
  10. 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
  11. 2022FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformercited by 133
  12. 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 69
10 more
  1. 2024CAT-SAM: Conditional Tuning for Few-Shot Adaptation of Segment Anything Modelcited by 27
  2. 2022CrackSeg9k: A Collection and Benchmark for Crack Segmentation Datasets and Frameworkscited by 22
  3. 2025SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structurescited by 16
  4. 2023A Few-Shot Attention Recurrent Residual U-Net for Crack Segmentationcited by 8
  5. 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentationcited by 7
  6. 2024Topology-aware Mamba for Crack Segmentation in Structurescited by 6
  7. 2024Multi-scale Contrastive Adaptor Learning for Segmenting Anything in Underperformed Scenescited by 4
  8. 2025SAM3-UNet: Simplified Adaptation of Segment Anything Model 3cited by 4
  9. 2026MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attentioncited by 3
  10. 2026Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modelingcited by 1

Built on by

Not cited yet.