mlsanityData to 14 Oct 2026

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification

arXiv 2606.20390 ↗First posted 18 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated skin cancer classification from dermoscopic images remains challenging due to heterogeneous lesion structure, strong intra-class variability, and subtle visual differences between benign and malignant cases. Existing CNN/ViT pipelines typically rely on global or patch-level features and often combine patient metadata via late fusion, which limits spatially grounded multimodal reasoning. We present a novel region-based graph learning framework that explicitly models lesions as graphs of spatially coherent superpixel regions represented as frozen CNN features. To capture fine-grained lesion arrangements, we encode inter-regional geometry as edge attributes and introduce a dedicated metadata context node connected to all regions, providing structured integration of demographic/clinical variables within the same relational space. Node representations are updated using our edge-aware graph transformer followed by attention-driven propagation, and a final graph-level embedding for benign-malignant classification. Experiments on four public benchmarks demonstrate that explicit region-level relational modeling and graph-native multimodal fusion yield consistent gains over the state-of-the-art. Consequently, we establish a new graph-centric perspective in which CNN features are modeled as relational nodes and improved through contextual integration, yielding more expressive and robust classifications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 36 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

9 of 36 references.

References · 9

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  3. 2020PAD-UFES-20: a skin lesion dataset composed of patient data and clinical images collected from smartphonescited by 118
  4. 2018Attention-based Graph Neural Network for Semi-supervised Learningcited by 101
  5. 2021Soft-Attention Improves Skin Cancer Classification Performancecited by 15
  6. 2022Deeply Supervised Skin Lesions Diagnosis with Stage and Branch Attentioncited by 4
  7. 2024Key Patches Are All You Need: A Multiple Instance Learning Framework For Robust Medical Diagnosiscited by 3
  8. 2025Diffusion models applied to skin and oral cancer classificationcited by 3
  9. 2025Skin Lesion Phenotyping via Nested Multi-modal Contrastive Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Confidence-Weighted Semi-Supervised Learning for Skin Lesion Segmentation Using Hybrid CNN-Transformer Networks
  2. 2025Hybrid Ensemble of Segmentation-Assisted Classification and GBDT for Skin Cancer Detection with Engineered Metadata and Synthetic Lesions from ISIC 2024 Non-Dermoscopic 3D-TBP Images
  3. 2024SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance
  4. 2026Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification
  5. 2026CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
  6. 2023SkinDistilViT: Lightweight Vision Transformer for Skin Lesion Classification
  7. 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation
  8. 2023DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation