Interactive Multi-Turn Retrieval for Health Videos
Not on the map. Why?
Abstract (arXiv)
The growing availability of health-related instructional videos creates new opportunities for clinical training, patient rehabilitation, and health education, yet existing retrieval systems remain largely single-turn: a user submits one query and receives one ranked list. This interaction is brittle in health scenarios, where information needs are often vague at first and become clinically meaningful only after follow-up constraints such as posture, hand placement, contraindications, equipment, or patient condition are specified. We introduce interactive multi-turn semantic retrieval for health videos and construct MHVRC, a Multi-Turn Health Video Retrieval Corpus, by combining video-grounded descriptions from VideoChat-Flash with query refinements generated by DeepSeek. We further propose DATR, a Dialogue-Aware Two-Stage Retrieval framework. DATR first performs efficient coarse retrieval with a CLIP-style dual encoder and sparse frame sampling, then re-ranks the top candidates through multi-turn query fusion and a lightweight cross-encoder scoring module. Experiments on MHVRC show consistent gains over strong text-video retrieval baselines, while user studies indicate that refined multi-turn queries better capture fine-grained procedural semantics than single-turn annotations. The work establishes a benchmark and a scalable technical recipe for interactive health video retrieval.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 43 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
32 of 43 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2022Human Motion Diffusion Modelcited by 1,062
- 2017Dense-Captioning Events in Videoscited by 789
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2017Localizing Moments in Video with Natural Languagecited by 660
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2019Passage Re-ranking with BERTcited by 629
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
20 more
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 463
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
- 2020HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingcited by 362
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2025UniAVGen: Unified Audio and Video Generation with Asymmetric Cross-Modal Interactionscited by 35
- 2024SemTalk: Holistic Co-speech Motion Generation with Frame-level Semantic Emphasiscited by 32
- 2024A Survey of Conversational Searchcited by 22
- 2025MEGADance: Mixture-of-Experts Architecture for Genre-Aware 3D Dance Generationcited by 18
- 2025EchoMask: Speech-Queried Attention-based Mask Modeling for Holistic Co-Speech Motion Generationcited by 17
- 2023BeatDance: A Beat-Based Model-Agnostic Contrastive Learning Framework for Music-Dance Retrievalcited by 12
- 2025FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generationcited by 10
- 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generationcited by 9
- 2026BiTDiff: Fine-Grained 3D Conducting Motion Generation via BiMamba-Transformer Diffusioncited by 2
Built on by
Not cited yet.