mlsanityData to 7 Oct 2026

Agreement Disagreement Guided Knowledge Transfer for Cross-Scene Hyperspectral Imaging

arXiv 2512.08990 ↗First posted 8 Dec 2025eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Knowledge transfer plays a crucial role in cross-scene hyperspectral imaging (HSI). However, existing studies often overlook the challenges of gradient conflicts and dominant gradients that arise during the optimization of shared parameters. Moreover, many current approaches fail to simultaneously capture both agreement and disagreement information, relying only on a limited shared subset of target features and consequently missing the rich, diverse patterns present in the target scene. To address these issues, we propose an Agreement Disagreement Guided Knowledge Transfer (ADGKT) framework that integrates both mechanisms to enhance cross-scene transfer. The agreement component includes GradVac, which aligns gradient directions to mitigate conflicts between source and target domains, and LogitNorm, which regulates logit magnitudes to prevent domination by a single gradient source. The disagreement component consists of a Disagreement Restriction (DiR) and an ensemble strategy, which capture diverse predictive target features and mitigate the loss of critical target information. Extensive experiments demonstrate the effectiveness and superiority of the proposed method in achieving robust and balanced knowledge transfer across heterogeneous HSI scenes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

16 of 37 references.

References · 16

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  4. 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 292
  5. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
  6. 2018Knowledge Distillation by On-the-Fly Native Ensemblecited by 186
  7. 2020Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Modelscited by 167
  8. 2019Online Knowledge Distillation with Diverse Peerscited by 127
  9. 2020A Survey on Negative Transfercited by 120
  10. 2022Agree to Disagree: Diversity through Disagreement for Better Transferabilitycited by 69
  11. 2023Independent Component Alignment for Multi-Task Learningcited by 69
  12. 2019Feature Fusion for Online Mutual Knowledge Distillationcited by 40
4 more
  1. 2022On the Versatile Uses of Partial Distance Correlation in Deep Learningcited by 18
  2. 2019Active Multi-Kernel Domain Adaptation for Hyperspectral Image Classificationcited by 12
  3. 2018Cross-domain CNN for Hyperspectral Image Classificationcited by 5
  4. 2022Exploring Cross-Domain Pretrained Model for Hyperspectral Image Classificationcited by 5

Built on by

Not cited yet.