mlsanityData to 7 Oct 2026

Nested Hash Layer: A Plug-and-play Module for Multiple-length Hash Code Learning

arXiv 2412.08922 ↗First posted 12 Dec 2024cs.CV cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

Deep supervised hashing is essential for efficient storage and search in large-scale image retrieval. Traditional deep supervised hashing models generate single-length hash codes, but this creates a trade-off between efficiency and effectiveness for different code lengths. To find the optimal length for a task, multiple models must be trained, increasing time and computation. Furthermore, relationships between hash codes of different lengths are often ignored. To address these issues, we propose the Nested Hash Layer (NHL), a plug-and-play module for deep supervised hashing models. NHL generates hash codes of multiple lengths simultaneously in a nested structure. To resolve optimization conflicts from multiple learning objectives, we introduce a dominance-aware dynamic weighting strategy to adjust gradients. Additionally, we propose a long-short cascade self-distillation method, where long hash codes guide the learning of shorter ones, improving overall code quality. Experiments indicate that the NHL achieves an overall training speed improvement of approximately 5 to 8 times across various deep supervised hashing models and enhances the average performance of these models by about 3.4%.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

26 of 49 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  5. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  6. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  7. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  8. 2018End-to-End Multi-Task Learning with Attentioncited by 533
  9. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
  10. 2022Matryoshka Representation Learningcited by 268
  11. 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
  12. 2020Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropoutcited by 199
14 more
  1. 2021RotoGrad: Gradient Homogenization in Multitask Learningcited by 82
  2. 2019Central Similarity Quantization for Efficient Image and Video Retrievalcited by 77
  3. 2020MTL-NAS: Task-Agnostic Neural Architecture Search towards General-Purpose Multi-Task Learningcited by 50
  4. 2023Recon: Reducing Conflicting Gradients from the Root for Multi-Task Learningcited by 50
  5. 2020A Survey on Deep Hashing Methodscited by 47
  6. 2021One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objectivecited by 43
  7. 2019Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernelscited by 42
  8. 2017Asymmetric Deep Supervised Hashingcited by 35
  9. 2016Deep Supervised Hashing with Triplet Labelscited by 27
  10. 2021Unsupervised Hashing with Contrastive Information Bottleneckcited by 24
  11. 2019Deep Triplet Quantizationcited by 16
  12. 2018Hashing with Mutual Informationcited by 9
  13. 2018Collaborative Learning for Extremely Low Bit Asymmetric Hashingcited by 7
  14. 2019Push for Quantization: Deep Fisher Hashingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.