HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning
Not on the map. Why?
Abstract (arXiv)
Partially Relevant Video Retrieval (PRVR) addresses the critical challenge of matching untrimmed videos with text queries describing only partial content. Existing methods suffer from geometric distortion in Euclidean space that sometimes misrepresents the intrinsic hierarchical structure of videos and overlooks certain hierarchical semantics, ultimately leading to suboptimal temporal modeling. To address this issue, we propose the first hyperbolic modeling framework for PRVR, namely HLFormer, which leverages hyperbolic space learning to compensate for the suboptimal hierarchical modeling capabilities of Euclidean space. Specifically, HLFormer integrates the Lorentz Attention Block and Euclidean Attention Block to encode video embeddings in hybrid spaces, using the Mean-Guided Adaptive Interaction Module to dynamically fuse features. Additionally, we introduce a Partial Order Preservation Loss to enforce "text < video" hierarchy through Lorentzian cone constraints. This approach further enhances cross-modal matching by reinforcing partial relevance between video content and text queries. Extensive experiments show that HLFormer outperforms state-of-the-art methods. Code is released at https://github.com/lijun2005/ICCV25-HLFormer.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 46 of its 66 references that are in the map. First posted on arXiv 23 Jul 2025.
Builds on
46 of 66 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2017Dense-Captioning Events in Videoscited by 793
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 265
34 more
- 2019Hyperbolic Image Embeddingscited by 221
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
- 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
- 2020Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoningcited by 180
- 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 111
- 2021Fully Hyperbolic Neural Networkscited by 108
- 2022Hyperbolic Image Segmentationcited by 102
- 2022Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?cited by 90
- 2018Dual Encoding for Zero-Example Video Retrievalcited by 85
- 2024Compositional Entailment Learning for Hyperbolic Vision-Language Modelscited by 74
- 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
- 2017Predicting Visual Features from Text for Image and Video Caption Retrievalcited by 53
- 2021HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projectionscited by 47
- 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
- 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
- 2020A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpuscited by 26
- 2023GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalcited by 20
- 2022Skin Lesion Recognition with Class-Hierarchy Regularized Hyperbolic Embeddingscited by 19
- 2025Missing Target-Relevant Information Prediction with World Model for Accurate Zero-Shot Composed Image Retrievalcited by 18
- 2022Hyperbolic Uncertainty Aware Semantic Segmentationcited by 17
- 2024Lorentzian Residual Neural Networkscited by 17
- 2025Grounding Language with Vision: A Conditional Mutual Information Calibrated Decoding Strategy for Reducing Hallucinations in LVLMscited by 17
- 2019Fully Hyperbolic Convolutional Neural Networkscited by 15
- 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
- 2024GMMFormer v2: An Uncertainty-aware Framework for Partially Relevant Video Retrievalcited by 12
- 2024Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Groundingcited by 10
- 2024Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detectioncited by 10
- 2025Ambiguity-Restrained Text-Video Representation Learning for Partially Relevant Video Retrievalcited by 10
- 2022Hybrid Contrastive Quantization for Efficient Cross-View Video Retrievalcited by 8
- 2025EvdCLIP: Improving Vision-Language Retrieval with Entity Visual Descriptions from Large Language Modelscited by 6
- 2023Keyword-Based Diverse Image Retrieval by Semantics-aware Contrastive Learning and Transformercited by 5
- 2025Protecting Your Video Content: Disrupting Automated Video-based LLM Annotationscited by 5
- 2025An Empirical Study of Federated Prompt Learning for Vision Language Modelcited by 3
Built on by
Citing papers per year: 2025: 5; 2026: 12.
17 papers.
Sort:
By area:
- 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptationcited by 4
- 2025AsyMoE: Leveraging Modal Asymmetry for Enhanced Expert Specialization in Large Vision-Language Modelscited by 3
- 2026ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledgecited by 3
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrievalcited by 3
- 2026Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrievalcited by 2
- 2025ProPy: Building Interactive Prompt Pyramids upon CLIP for Partially Relevant Video Retrievalcited by 1
- 2025Brain-HGCN: A Hyperbolic Graph Convolutional Network for Brain Functional Network Analysiscited by 1
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learningcited by 1
- 2026ARGENT: Adaptive Hierarchical Image-Text Representationscited by 1
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1
- 2025H3Former: Hypergraph-based Semantic-Aware Aggregation via Hyperbolic Hierarchical Contrastive Loss for Fine-Grained Visual Classificationcited by 0
- 2026LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognitioncited by 0
5 more
- 2026Hierarchical Co-Embedding of Font Shapes and Impression Tagscited by 0
- 2026Hyperbolic Hierarchical Clustering for Visual Representation Learningcited by 0
- 2026Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrievalcited by 0
- 2026Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrievalcited by 0
- 2026CurvSpec: Adaptive Multi-Curvature Learning for Partial Relevant Video Retrievalcited by 0
- 2026CurvSpec: Adaptive Multi-Curvature Learning for Partial Relevant Video Retrieval29 Sep 2026
- 2026Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval8 Sep 2026
- 2026Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrieval4 Sep 2026
- 2026Hyperbolic Hierarchical Clustering for Visual Representation Learning24 Aug 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrieval7 May 2026
- 2026Hierarchical Co-Embedding of Font Shapes and Impression Tags5 Apr 2026
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrieval4 Apr 2026
- 2026LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognition30 Mar 2026
- 2026ARGENT: Adaptive Hierarchical Image-Text Representations24 Mar 2026
- 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptation24 Feb 2026
- 2026ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledge10 Feb 2026
5 more
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learning23 Dec 2025
- 2025H3Former: Hypergraph-based Semantic-Aware Aggregation via Hyperbolic Hierarchical Contrastive Loss for Fine-Grained Visual Classification13 Nov 2025
- 2025Brain-HGCN: A Hyperbolic Graph Convolutional Network for Brain Functional Network Analysis18 Sep 2025
- 2025AsyMoE: Leveraging Modal Asymmetry for Enhanced Expert Specialization in Large Vision-Language Models16 Sep 2025
- 2025ProPy: Building Interactive Prompt Pyramids upon CLIP for Partially Relevant Video Retrieval26 Aug 2025
- 2026ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledgecited by 3
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrievalcited by 3
- 2026Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrievalcited by 2
- 2025ProPy: Building Interactive Prompt Pyramids upon CLIP for Partially Relevant Video Retrievalcited by 1
- 2025Brain-HGCN: A Hyperbolic Graph Convolutional Network for Brain Functional Network Analysiscited by 1
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learningcited by 1
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1
- 2025H3Former: Hypergraph-based Semantic-Aware Aggregation via Hyperbolic Hierarchical Contrastive Loss for Fine-Grained Visual Classificationcited by 0
- 2026LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognitioncited by 0
- 2026Hierarchical Co-Embedding of Font Shapes and Impression Tagscited by 0
- 2026Hyperbolic Hierarchical Clustering for Visual Representation Learningcited by 0
- 2026Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrievalcited by 0
12 most cited of 14 All 14 (JSON)
- 2026CurvSpec: Adaptive Multi-Curvature Learning for Partial Relevant Video Retrieval29 Sep 2026
- 2026Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval8 Sep 2026
- 2026Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrieval4 Sep 2026
- 2026Hyperbolic Hierarchical Clustering for Visual Representation Learning24 Aug 2026
- 2026Attend to Anything: Foundation Model for Unified Human Attention Modeling2 Jun 2026
- 2026Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrieval7 May 2026
- 2026Hierarchical Co-Embedding of Font Shapes and Impression Tags5 Apr 2026
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrieval4 Apr 2026
- 2026LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognition30 Mar 2026
- 2026ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledge10 Feb 2026
- 2025H2em: Learning Hierarchical Hyperbolic Embeddings for Compositional Zero-Shot Learning23 Dec 2025
- 2025H3Former: Hypergraph-based Semantic-Aware Aggregation via Hyperbolic Hierarchical Contrastive Loss for Fine-Grained Visual Classification13 Nov 2025
12 newest of 14 All 14 (JSON)