mlsanityData to 7 Oct 2026

Diffusion-Guided Mask-Consistent Paired Mixing for Endoscopic Image Segmentation

arXiv 2511.03219 ↗First posted 5 Nov 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Augmentation for dense prediction typically relies on either sample mixing or generative synthesis. Mixing improves robustness but misaligned masks yield soft label ambiguity. Diffusion synthesis increases apparent diversity but, when trained as common samples, overlooks the structural benefit of mask conditioning and introduces synthetic-real domain shift. We propose a paired, diffusion-guided paradigm that fuses the strengths of both. For each real image, a synthetic counterpart is generated under the same mask and the pair is used as a controllable input for Mask-Consistent Paired Mixing (MCPMix), which mixes only image appearance while supervision always uses the original hard mask. This produces a continuous family of intermediate samples that smoothly bridges synthetic and real appearances under shared geometry, enlarging diversity without compromising pixel-level semantics. To keep learning aligned with real data, Real-Anchored Learnable Annealing (RLA) adaptively adjusts the mixing strength and the loss weight of mixed samples over training, gradually re-anchoring optimization to real data and mitigating distributional bias. Across Kvasir-SEG, PICCOLO, CVC-ClinicDB, a private NPC-LES cohort, and ISIC 2017, the approach achieves state-of-the-art segmentation performance and consistent gains over baselines. The results show that combining label-preserving mixing with diffusion-driven diversity, together with adaptive re-anchoring, yields robust and generalizable endoscopic segmentation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 40 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

21 of 40 references.

References · 21

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  5. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
  8. 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
  9. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  10. 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 260
  11. 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 220
  12. 2020ClassMix: Segmentation-Based Data Augmentation for Semi-Supervised Learningcited by 209
9 more
  1. 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
  2. 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
  3. 2024DiffuseMix: Label-Preserving Data Augmentation with Diffusion Modelscited by 78
  4. 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Modelscited by 69
  5. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
  6. 2022A Unified Analysis of Mixed Sample Data Augmentation: A Loss Function Perspectivecited by 27
  7. 2023Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstructioncited by 15
  8. 2023Generation of Structurally Realistic Retinal Fundus Images with Diffusion Modelscited by 9
  9. 2024A Point-Neighborhood Learning Framework for Nasal Endoscope Image Segmentationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.