The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery
Not on the map. Why?
Abstract (arXiv)
Generalized Category Discovery (GCD) leverages labeled data to categorize unlabeled samples from known or unknown classes. Most previous methods jointly optimize supervised and unsupervised objectives and achieve promising results. However, inherent optimization interference still limits their ability to improve further. Through quantitative analysis, we identify a key issue, i.e., gradient entanglement, which 1) distorts supervised gradients and weakens discrimination among known classes, and 2) induces representation-subspace overlap between known and novel classes, reducing the separability of novel categories. To address this issue, we propose the Energy-Aware Gradient Coordinator (EAGC), a plug-and-play gradient-level module that explicitly regulates the optimization process. EAGC comprises two components: Anchor-based Gradient Alignment (AGA) and Energy-aware Elastic Projection (EEP). AGA introduces a reference model to anchor the gradient directions of labeled samples, preserving the discriminative structure of known classes against the interference of unlabeled gradients. EEP softly projects unlabeled gradients onto the complement of the known-class subspace and derives an energy-based coefficient to adaptively scale the projection for each unlabeled sample according to its degree of alignment with the known subspace, thereby reducing subspace overlap without suppressing unlabeled samples that likely belong to known classes. Experiments show that EAGC consistently boosts existing methods and establishes new state-of-the-art results. Code is available at https://haiyangzheng.github.io/EAGC.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 74 of its 94 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
74 of 94 references.
References · 74
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
- 2021Gradient Projection Memory for Continual Learningcited by 348
- 2019Learning to Discover Novel Visual Categories via Deep Transfer Clusteringcited by 225
- 2022Generalized Category Discoverycited by 211
- 2021Open-World Semi-Supervised Learningcited by 165
- 2021A Unified Objective for Novel Class Discoverycited by 162
- 2021Neighborhood Contrastive Learning for Novel Class Discoverycited by 121
- 2022Parametric Classification for Generalized Category Discovery: A Baseline Studycited by 113
- 2021Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillationcited by 104
38 more
- 2020OpenMix: Reviving Known Knowledge for Discovering Novel Visual Categories in An Open Worldcited by 93
- 2023Dynamic Conceptional Contrastive Learning for Generalized Category Discoverycited by 92
- 2022PromptCAL: Contrastive Affinity Learning via Auxiliary Prompts for Generalized Novel Category Discoverycited by 87
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2023Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discoverycited by 72
- 2023No Representation Rules Them All in Category Discoverycited by 61
- 2019The Herbarium Challenge 2019 Datasetcited by 60
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2024SPTNet: An Efficient Alternative Framework for Generalized Category Discovery with Spatial Prompt Tuningcited by 51
- 2022XCon: Learning with Experts for Fine-grained Category Discoverycited by 50
- 2022Parametric Information Maximization for Generalized Category Discoverycited by 39
- 2023Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discoverycited by 39
- 2024Contrastive Mean-Shift Learning for Generalized Category Discoverycited by 39
- 2024SelEx: Self-Expertise in Fine-Grained Generalized Category Discoverycited by 34
- 2022Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformerscited by 33
- 2022OpenCon: Open-world Contrastive Learningcited by 33
- 2024Textual Knowledge Matters: Cross-Modality Co-Teaching for Generalized Visual Class Discoverycited by 31
- 2025Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensingcited by 31
- 2023A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsamplingcited by 28
- 2023Federated Generalized Category Discoverycited by 27
- 2024GET: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discoverycited by 27
- 2022Modeling Inter-Class and Intra-Class Constraints in Novel Class Discoverycited by 26
- 2025Solving the Catastrophic Forgetting Problem in Generalized Category Discoverycited by 26
- 2023CLIP-GCD: Simple Language Guided Generalized Category Discoverycited by 25
- 2023Unknown Sniffer for Object Detection: Don't Turn a Blind Eye to Unknown Objectscited by 23
- 2023Class-relation Knowledge Distillation for Novel Class Discoverycited by 23
- 2024HiLo: A Learning Framework for Generalized Category Discovery Robust to Domain Shiftscited by 23
- 2024An End-to-End Robust Point Cloud Semantic Segmentation Network with Single-Step Conditional Diffusion Modelscited by 23
- 2023A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised Learningcited by 22
- 2023When and How Does Known Class Help Discover Unknown Ones? Provable Understanding Through Spectral Analysiscited by 21
- 2024Prototypical Hash Encoding for On-the-Fly Fine-Grained Category Discoverycited by 21
- 2025Hyperbolic Category Discoverycited by 20
- 2022Boosting Novel Category Discovery Over Domains with Soft Contrastive Learning and All-in-One Classifiercited by 18
- 2014Controlling Recurrent Neural Networks by Conceptorscited by 16
- 2025DebGCD: Debiased Learning with Distribution Guidance for Generalized Category Discoverycited by 15
- 2025MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignmentcited by 15
- 2024Novel Class Discovery for Ultra-Fine-Grained Visual Categorizationcited by 13
- 2025Adaptive Part Learning for Fine-Grained Generalized Category Discovery: A Plug-and-Play Enhancementcited by 13
50 most cited of 74 All 74 (JSON)
Built on by
Not cited yet.