Nested Hash Layer: A Plug-and-play Module for Multiple-length Hash Code Learning
Not on the map. Why?
Abstract (arXiv)
Deep supervised hashing is essential for efficient storage and search in large-scale image retrieval. Traditional deep supervised hashing models generate single-length hash codes, but this creates a trade-off between efficiency and effectiveness for different code lengths. To find the optimal length for a task, multiple models must be trained, increasing time and computation. Furthermore, relationships between hash codes of different lengths are often ignored. To address these issues, we propose the Nested Hash Layer (NHL), a plug-and-play module for deep supervised hashing models. NHL generates hash codes of multiple lengths simultaneously in a nested structure. To resolve optimization conflicts from multiple learning objectives, we introduce a dominance-aware dynamic weighting strategy to adjust gradients. Additionally, we propose a long-short cascade self-distillation method, where long hash codes guide the learning of shorter ones, improving overall code quality. Experiments indicate that the NHL achieves an overall training speed improvement of approximately 5 to 8 times across various deep supervised hashing models and enhances the average performance of these models by about 3.4%.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 12 Dec 2024.
Builds on
26 of 49 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
- 2022Matryoshka Representation Learningcited by 268
- 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
- 2020Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropoutcited by 199
14 more
- 2021RotoGrad: Gradient Homogenization in Multitask Learningcited by 82
- 2019Central Similarity Quantization for Efficient Image and Video Retrievalcited by 77
- 2020MTL-NAS: Task-Agnostic Neural Architecture Search towards General-Purpose Multi-Task Learningcited by 50
- 2023Recon: Reducing Conflicting Gradients from the Root for Multi-Task Learningcited by 50
- 2020A Survey on Deep Hashing Methodscited by 47
- 2021One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objectivecited by 43
- 2019Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernelscited by 42
- 2017Asymmetric Deep Supervised Hashingcited by 35
- 2016Deep Supervised Hashing with Triplet Labelscited by 27
- 2021Unsupervised Hashing with Contrastive Information Bottleneckcited by 24
- 2019Deep Triplet Quantizationcited by 16
- 2018Hashing with Mutual Informationcited by 9
- 2018Collaborative Learning for Extremely Low Bit Asymmetric Hashingcited by 7
- 2019Push for Quantization: Deep Fisher Hashingcited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.