mlsanityData to 14 Oct 2026

HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning

arXiv 2507.17402 ↗First posted 23 Jul 2025cs.CV cs.IR cs.MMcited by 17

Not on the map. Why?

Abstract (arXiv)

Partially Relevant Video Retrieval (PRVR) addresses the critical challenge of matching untrimmed videos with text queries describing only partial content. Existing methods suffer from geometric distortion in Euclidean space that sometimes misrepresents the intrinsic hierarchical structure of videos and overlooks certain hierarchical semantics, ultimately leading to suboptimal temporal modeling. To address this issue, we propose the first hyperbolic modeling framework for PRVR, namely HLFormer, which leverages hyperbolic space learning to compensate for the suboptimal hierarchical modeling capabilities of Euclidean space. Specifically, HLFormer integrates the Lorentz Attention Block and Euclidean Attention Block to encode video embeddings in hybrid spaces, using the Mean-Guided Adaptive Interaction Module to dynamically fuse features. Additionally, we introduce a Partial Order Preservation Loss to enforce "text < video" hierarchy through Lorentzian cone constraints. This approach further enhances cross-modal matching by reinforcing partial relevance between video content and text queries. Extensive experiments show that HLFormer outperforms state-of-the-art methods. Code is released at https://github.com/lijun2005/ICCV25-HLFormer.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 46 of its 66 references that are in the map. First posted on arXiv 23 Jul 2025.

Builds on

46 of 66 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  8. 2017Dense-Captioning Events in Videoscited by 793
  9. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  10. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  11. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  12. 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 265
34 more
  1. 2019Hyperbolic Image Embeddingscited by 221
  2. 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
  3. 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
  4. 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
  5. 2020Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoningcited by 180
  6. 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 111
  7. 2021Fully Hyperbolic Neural Networkscited by 108
  8. 2022Hyperbolic Image Segmentationcited by 102
  9. 2022Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?cited by 90
  10. 2018Dual Encoding for Zero-Example Video Retrievalcited by 85
  11. 2024Compositional Entailment Learning for Hyperbolic Vision-Language Modelscited by 74
  12. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  13. 2017Predicting Visual Features from Text for Image and Video Caption Retrievalcited by 53
  14. 2021HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projectionscited by 47
  15. 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
  16. 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
  17. 2020A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpuscited by 26
  18. 2023GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalcited by 20
  19. 2022Skin Lesion Recognition with Class-Hierarchy Regularized Hyperbolic Embeddingscited by 19
  20. 2025Missing Target-Relevant Information Prediction with World Model for Accurate Zero-Shot Composed Image Retrievalcited by 18
  21. 2022Hyperbolic Uncertainty Aware Semantic Segmentationcited by 17
  22. 2024Lorentzian Residual Neural Networkscited by 17
  23. 2025Grounding Language with Vision: A Conditional Mutual Information Calibrated Decoding Strategy for Reducing Hallucinations in LVLMscited by 17
  24. 2019Fully Hyperbolic Convolutional Neural Networkscited by 15
  25. 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
  26. 2024GMMFormer v2: An Uncertainty-aware Framework for Partially Relevant Video Retrievalcited by 12
  27. 2024Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Groundingcited by 10
  28. 2024Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detectioncited by 10
  29. 2025Ambiguity-Restrained Text-Video Representation Learning for Partially Relevant Video Retrievalcited by 10
  30. 2022Hybrid Contrastive Quantization for Efficient Cross-View Video Retrievalcited by 8
  31. 2025EvdCLIP: Improving Vision-Language Retrieval with Entity Visual Descriptions from Large Language Modelscited by 6
  32. 2023Keyword-Based Diverse Image Retrieval by Semantics-aware Contrastive Learning and Transformercited by 5
  33. 2025Protecting Your Video Content: Disrupting Automated Video-based LLM Annotationscited by 5
  34. 2025An Empirical Study of Federated Prompt Learning for Vision Language Modelcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 12.

17 papers.

Sort:

By area:

  1. 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptationcited by 4
  2. 2025AsyMoE: Leveraging Modal Asymmetry for Enhanced Expert Specialization in Large Vision-Language Modelscited by 3
  3. 2026ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledgecited by 3
  4. 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrievalcited by 3
  5. 2026Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrievalcited by 2
  6. 2025ProPy: Building Interactive Prompt Pyramids upon CLIP for Partially Relevant Video Retrievalcited by 1
  7. 2025Brain-HGCN: A Hyperbolic Graph Convolutional Network for Brain Functional Network Analysiscited by 1
  8. 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learningcited by 1
  9. 2026ARGENT: Adaptive Hierarchical Image-Text Representationscited by 1
  10. 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1
  11. 2025H3Former: Hypergraph-based Semantic-Aware Aggregation via Hyperbolic Hierarchical Contrastive Loss for Fine-Grained Visual Classificationcited by 0
  12. 2026LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognitioncited by 0
5 more
  1. 2026Hierarchical Co-Embedding of Font Shapes and Impression Tagscited by 0
  2. 2026Hyperbolic Hierarchical Clustering for Visual Representation Learningcited by 0
  3. 2026Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrievalcited by 0
  4. 2026Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrievalcited by 0
  5. 2026CurvSpec: Adaptive Multi-Curvature Learning for Partial Relevant Video Retrievalcited by 0