mlsanityData to 13 Oct 2026

Delving Deeper: Hierarchical Visual Perception for Robust Video-Text Retrieval

arXiv 2601.12768 ↗First posted 19 Jan 2026cs.CV cs.MMcited by 23

Not on the map. Why?

Abstract (arXiv)

Video-text retrieval (VTR) aims to locate relevant videos using natural language queries. Current methods, often based on pre-trained models like CLIP, are hindered by video's inherent redundancy and their reliance on coarse, final-layer features, limiting matching accuracy. To address this, we introduce the HVP-Net (Hierarchical Visual Perception Network), a framework that mines richer video semantics by extracting and refining features from multiple intermediate layers of a vision encoder. Our approach progressively distills salient visual concepts from raw patch-tokens at different semantic levels, mitigating redundancy while preserving crucial details for alignment. This results in a more robust video representation, leading to new state-of-the-art performance on challenging benchmarks including MSRVTT, DiDeMo, and ActivityNet. Our work validates the effectiveness of exploiting hierarchical features for advancing video-text retrieval. Our codes are available at https://github.com/boyun-zhang/HVP-Net.

Key facts. Cited by 23 papers in the map (data through 13 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

16 of 27 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
  3. 2017Dense-Captioning Events in Videoscited by 790
  4. 2017Localizing Moments in Video with Natural Languagecited by 661
  5. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 650
  6. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  7. 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
  8. 2022CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignmentcited by 74
  9. 2023DiffusionRet: Generative Text-Video Retrieval with Diffusion Modelcited by 52
  10. 2020Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrievalcited by 47
  11. 2023Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learningcited by 45
  12. 2025Chat-Driven Text Generation and Interaction for Person Retrievalcited by 34
4 more
  1. 2021Understanding the Dynamics of DNNs Using Graph Modularitycited by 26
  2. 2025Dynamic Uncertainty Learning with Noisy Correspondence for Text-Based Person Searchcited by 11
  3. 2024MUSE: Mamba is Efficient Multi-scale Learner for Text-video Retrievalcited by 7
  4. 2021VLDeformer: Vision-Language Decomposed Transformer for Fast Cross-Modal Retrievalcited by 6

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 23.

23 papers.

Sort:

By area:

  1. 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 39
  2. 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
  3. 2026HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrievalcited by 24
  4. 2026HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Networkcited by 18
  5. 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrievalcited by 18
  6. 2026MELT: Improve Composed Image Retrieval via the Modification Frequentation-Rarity Balance Networkcited by 17
  7. 2026CONQUER: Context-Aware Representation with Query Enhancement for Text-Based Person Searchcited by 15
  8. 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 15
  9. 2026HVD: Human Vision-Driven Video Representation Learning for Text-Video Retrievalcited by 14
  10. 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidancecited by 12
  11. 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillationcited by 11
  12. 2026Recursive Self-Evolving Agents via Held-Out Selectioncited by 6
11 more
  1. 2026Rethinking LoRA for Privacy-Preserving Federated Learning in Large Modelscited by 4
  2. 2026Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Searchcited by 4
  3. 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
  4. 2026BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviationcited by 1
  5. 2026Mitigating Hallucination on Hallucination in RAG via Ensemble Votingcited by 1
  6. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offscited by 1
  7. 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
  8. 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarkingcited by 0
  9. 2026On the Controllability-Fidelity Frontier in Diffusion Editingcited by 0
  10. 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inferencecited by 0
  11. 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivotingcited by 0