mlsanityData to 7 Oct 2026

Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning

arXiv 2003.00392 ↗First posted 1 Mar 2020cs.CV cs.AIcited by 180

Not on the map. Why?

Abstract (arXiv)

Cross-modal retrieval between videos and texts has attracted growing attentions due to the rapid emergence of videos on the web. The current dominant approach for this problem is to learn a joint embedding space to measure cross-modal similarities. However, simple joint embeddings are insufficient to represent complicated visual and textual details, such as scenes, objects, actions and their compositions. To improve fine-grained video-text retrieval, we propose a Hierarchical Graph Reasoning (HGR) model, which decomposes video-text matching into global-to-local levels. To be specific, the model disentangles texts into hierarchical semantic graph including three levels of events, actions, entities and relationships across levels. Attention-based graph reasoning is utilized to generate hierarchical textual embeddings, which can guide the learning of diverse and hierarchical video representations. The HGR model aggregates matchings from different video-text levels to capture both global and local details. Experimental results on three video-text datasets demonstrate the advantages of our model. Such hierarchical decomposition also enables better generalization across datasets and improves the ability to distinguish fine-grained semantic differences.

Key facts. Cited by 180 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Mar 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 40; 2023: 50; 2024: 31; 2025: 22; 2026: 8.

180 papers.

Sort:

By area:

  1. 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
  2. 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 168
  3. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
  4. 2021Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Losscited by 116
  5. 2022TS2-Net: Token Shift and Selection Transformer for Text-Video Retrievalcited by 104
  6. 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
  7. 2021TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignmentcited by 102
  8. 2021Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformerscited by 93
  9. 2022Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?cited by 90
  10. 2021HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrievalcited by 87
  11. 2021TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrievalcited by 81
  12. 2022Bridging Video-text Retrieval with Multiple Choice Questionscited by 79
38 more
  1. 2023Verbs in Action: Improving verb understanding in video-language modelscited by 76
  2. 2022HiTeA: Hierarchical Temporal-Aware Video-Language Pre-trainingcited by 72
  3. 2021Cross Modal Retrieval with Querybank Normalisationcited by 71
  4. 2022VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captionerscited by 69
  5. 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
  6. 2021Temporal Query Networks for Fine-grained Video Understandingcited by 68
  7. 2021Video as Conditional Graph Hierarchy for Multi-Granular Question Answeringcited by 68
  8. 2021Bridge to Answer: Structure-aware Graph Interaction Network for Video Question Answeringcited by 56
  9. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  10. 2023UATVR: Uncertainty-Adaptive Text-Video Retrievalcited by 55
  11. 2023DiffusionRet: Generative Text-Video Retrieval with Diffusion Modelcited by 52
  12. 2023Unified Coarse-to-Fine Alignment for Video-Text Retrievalcited by 49
  13. 2021On Semantic Similarity in Video Retrievalcited by 45
  14. 2023Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learningcited by 45
  15. 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 44
  16. 2021Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Modelscited by 41
  17. 2023Prompt Switch: Efficient CLIP Adaptation for Text-Video Retrievalcited by 35
  18. 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
  19. 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
  20. 2022COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrievalcited by 33
  21. 2022Improving Cross-Modal Retrieval with Set of Diverse Embeddingscited by 33
  22. 2024Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrievalcited by 33
  23. 2024Enhancing Video-Language Representations with Structural Spatio-Temporal Alignmentcited by 32
  24. 2021HANet: Hierarchical Alignment Networks for Video-Text Retrievalcited by 31
  25. 2023Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignmentcited by 31
  26. 2023A Review of Deep Learning for Video Captioningcited by 28
  27. 2022ComCLIP: Training-Free Compositional Image and Text Matchingcited by 26
  28. 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessmentcited by 24
  29. 2021Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrievalcited by 23
  30. 2022Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learningcited by 22
  31. 2023Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrievalcited by 22
  32. 2023Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?cited by 21
  33. 2023Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignmentcited by 21
  34. 2022Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrievalcited by 20
  35. 2023GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalcited by 20
  36. 2023Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Bankscited by 20
  37. 2023Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Groundingcited by 19
  38. 2023Accommodating Audio Modality in CLIP for Multimodal Processingcited by 18

50 most cited of 180 All 180 (JSON)