Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval
Not on the map. Why?
Abstract (arXiv)
Retrieving relevant instructional videos from multilingual medical archives is crucial for answering complex, multi-hop questions across language boundaries. However, existing systems either compress hour-long videos into coarse embeddings or incur prohibitive costs for fine-grained matching. We tackle the Multilingual Video Corpus Retrieval (mVCR) task in the NLPCC-2025 M4IVQA challenge with a multi-stage framework that integrates multilingual semantics, domain terminology, and efficient long-form processing. Video subtitles are divided into semantically coherent chunks, enriched with concise knowledge-graph (KG) facts, and organized into a hierarchical tree whose node embeddings are generated by a language-agnostic multilingual encoder. At query time, the same encoder embeds the input question; a coarse-to-fine tree search prunes irrelevant branches, and only the top-ranked chunks are re-scored by a lightweight large language model (LLM). This design avoids exhaustive cross-encoder scoring while preserving chunk-level precision. Experiments on the mVCR test set demonstrate state-of-the-art performance, and ablation studies confirm the complementary contributions of KG enrichment, hierarchical indexing, and targeted LLM re-ranking. The proposed method offers an accurate and scalable solution for multilingual retrieval in specialized medical video collections.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
22 of 36 references.
References · 22
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 412
- 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
- 2018A Joint Sequence Fusion Model for Video Question Answering and Retrievalcited by 208
- 2021SPViT: Enabling Faster Vision Transformers via Soft Token Pruningcited by 165
- 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
- 2018Dual Encoding for Zero-Example Video Retrievalcited by 85
- 2020Biomedical Entity Representations with Synonym Marginalizationcited by 59
- 2022Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Videocited by 43
- 2021More but Correct: Generating Diversified and Entity-revised Medical Responsecited by 31
10 more
- 2022Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Trainingcited by 24
- 2025Detection of AI Deepfake and Fraud in Online Payments Using GAN-Based Modelscited by 14
- 2024AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibilitycited by 11
- 2022Learning to Locate Visual Answer in Video Corpus Using Questioncited by 10
- 2023Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languagescited by 8
- 2024Contextual Bandits for Unbounded Context Distributionscited by 8
- 2022Visual Answer Localization with Cross-modal Mutual Knowledge Transfercited by 7
- 2023LLM-RM at SemEval-2023 Task 2: Multilingual Complex NER using XLM-RoBERTacited by 7
- 2025Overview of the NLPCC 2025 Shared Task 4: Multi-modal, Multilingual, and Multi-hop Medical Instructional Video Question Answering Challengecited by 5
- 2025Comparative Analysis of Large Language Models for Context-Aware Code Completion using SAFIM Frameworkcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.