Registration-Grounded Spectral Fusion for Unregistered WLI/NBI Endoscopic Lesion Segmentation
Not on the map. Why?
Abstract (arXiv)
White-light imaging (WLI) and narrow-band imaging (NBI) provide complementary views of endoscopic lesions, but their paired observations are often spatially misaligned due to viewpoint changes, tissue deformation, and sequential handheld acquisition. This makes direct WLI/NBI fusion prone to mixing non-corresponding regions and may even degrade segmentation around lesion boundaries. To address this problem, we propose a reliability-aware complex-domain fusion framework for paired-but-unregistered WLI/NBI lesion segmentation. The framework first establishes topology-regularized feature correspondence and further estimates where the cross-modal correspondence is reliable. Guided by this reliability, the model selectively fuses WLI and NBI features in a learnable complex representation. In this representation, WLI-derived cues mainly provide appearance-related magnitude responses, while NBI-derived cues provide structure-sensitive phase responses. Unlike conventional real-valued or symmetric multimodal fusion, the proposed method explicitly models the different roles of WLI and NBI and suppresses unreliable cross-modal interaction in locally mismatched regions. Experiments on paired WLI/NBI endoscopic datasets show that the proposed reliability-aware registration grounding and complex-domain fusion consistently improve lesion segmentation performance. Role-reversal and module ablation studies further validate the necessity of both the modality-role design and reliability-guided cross-modal interaction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
9 of 32 references.
References · 9
- 2021ShapeConv: Shape-aware Convolutional Layer for Indoor RGB-D Semantic Segmentationcited by 77
- 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2025Frequency Domain-Based Diffusion Model for Unpaired Image Dehazingcited by 11
- 2025Holistic White-light Polyp Classification via Alignment-free Dense Distillation of Auxiliary Optical Chromoendoscopycited by 4
- 2024A Point-Neighborhood Learning Framework for Nasal Endoscope Image Segmentationcited by 2
- 2024Unsupervised learning of spatially varying regularization for diffeomorphic image registrationcited by 2
- 2025Implicit Deformable Medical Image Registration with Learnable Kernelscited by 1
- 2025UniFuse: A Unified All-in-One Framework for Multi-Modal Medical Image Fusion Under Diverse Degradations and Misalignmentscited by 1
Built on by
Not cited yet.