mlsanityData to 7 Oct 2026

Pairing-free Group-level Knowledge Distillation for Robust Gastrointestinal Lesion Classification in White-Light Endoscopy

arXiv 2601.09209 ↗First posted 14 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

White-Light Imaging (WLI) is the standard for endoscopic cancer screening, but Narrow-Band Imaging (NBI) offers superior diagnostic details. A key challenge is transferring knowledge from NBI to enhance WLI-only models, yet existing methods are critically hampered by their reliance on paired NBI-WLI images of the same lesion, a costly and often impractical requirement that leaves vast amounts of clinical data untapped. In this paper, we break this paradigm by introducing PaGKD, a novel Pairing-free Group-level Knowledge Distillation framework that that enables effective cross-modal learning using unpaired WLI and NBI data. Instead of forcing alignment between individual, often semantically mismatched image instances, PaGKD operates at the group level to distill more complete and compatible knowledge across modalities. Central to PaGKD are two complementary modules: (1) Group-level Prototype Distillation (GKD-Pro) distills compact group representations by extracting modality-invariant semantic prototypes via shared lesion-aware queries; (2) Group-level Dense Distillation (GKD-Den) performs dense cross-modal alignment by guiding group-aware attention with activation-derived relation maps. Together, these modules enforce global semantic consistency and local structural coherence without requiring image-level correspondence. Extensive experiments on four clinical datasets demonstrate that PaGKD consistently and significantly outperforms state-of-the-art methods, achieving relative AUC improvements of 3.3%, 1.1%, 2.8%, and 3.2%, respectively, establishing a new direction for cross-modal learning from unpaired data.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

14 of 28 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  6. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
  7. 2022Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformerscited by 118
  8. 2020Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillationcited by 38
  9. 2021Colonoscopy Polyp Detection and Classification: Dataset Creation and Comparative Evaluationscited by 38
  10. 2022FFCNet: Fourier Transform-Based Frequency Learning and Complex Convolutional Network for Colon Disease Classificationcited by 10
  11. 2023SSL-CPCD: Self-supervised learning with composite pretext-class discrimination for improved generalisability in endoscopic image analysiscited by 7
  12. 2021Colorectal Polyp Classification from White-light Colonoscopy Images via Domain Alignmentcited by 6
2 more
  1. 2022Toward Clinically Assisted Colorectal Polyp Recognition via Structured Cross-modal Representation Consistencycited by 5
  2. 2025Holistic White-light Polyp Classification via Alignment-free Dense Distillation of Auxiliary Optical Chromoendoscopycited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.