Absorbing Gradient Conflicts: Modeling Semantic Variance via Kent Distributions for Cross-Modal Hashing
Not on the map. Why?
Abstract (arXiv)
Supervised proxy-based deep cross-modal hashing has become the dominant paradigm for large-scale retrieval. However, prevalent methods model class proxies as deterministic points in the embedding space. This rigid assumption causes severe gradient conflicts in multi-label scenarios, where gradient conflicts arising from label co-occurrence lead to severe gradient contention and optimization collapse. To resolve this, we propose Kent-based Distributional Proxy Hashing (KDPH), a novel framework that shifts proxy representation from static points to flexible anisotropic Kent distributions on the hypersphere. Unlike point proxies that must shift their positions to accommodate conflicting gradients, KDPH absorbs these conflicts by dynamically adjusting its directional variance. This allows the proxy to maintain a stable semantic mean direction while stretching to cover diverse label correlations. Furthermore, to ensure stable training of these geometric parameters, we derive a tailored loss function incorporating the Cayley transform to enforce strict orthogonality. To the best of our knowledge, KDPH is the first framework to successfully introduce the Kent distributions into cross-modal hashing. Experiments on three benchmark datasets demonstrate that KDPH mitigates proxy collapse and chaotic oscillation, significantly outperforms state-of-the-art methods. Code is available at https://github.com/Senmo996/KDPH-official-code.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
17 of 42 references.
References · 17
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
- 2017No Fuss Distance Metric Learning using Proxiescited by 225
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2019Probabilistic Face Embeddingscited by 171
- 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
- 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
- 2022Image-text Retrieval: A Survey on Recent Research and Developmentcited by 55
- 2016Deep Cross-Modal Hashingcited by 54
- 2024Reliable Conflictive Multi-View Learningcited by 45
5 more
- 2022Non-isotropy Regularization for Proxy-based Deep Metric Learningcited by 33
- 2018Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrievalcited by 29
- 2022A Non-isotropic Probabilistic Take on Proxy-based Deep Metric Learningcited by 19
- 2018Directional Statistics-based Deep Metric Learning for Image Classification and Retrievalcited by 16
- 2019Discriminative Few-Shot Learning Based on Directional Statisticscited by 3
Built on by
Not cited yet.