MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos
Not on the map. Why?
Abstract (arXiv)
Recent advances in video generation have shown remarkable progress in open-domain settings, yet medical video generation remains largely underexplored. Medical videos are critical for applications such as clinical training, education, and simulation, requiring not only high visual fidelity but also strict medical accuracy. However, current models often produce unrealistic or erroneous content when applied to medical prompts, largely due to the lack of large-scale, high-quality datasets tailored to the medical domain. To address this gap, we introduce MedVideoCap-55K, the first large-scale, diverse, and caption-rich dataset for medical video generation. It comprises over 55,000 curated clips spanning real-world medical scenarios, providing a strong foundation for training generalist medical video generation models. Built upon this dataset, we develop MedGen, which achieves leading performance among open-source models and rivals commercial systems across multiple benchmarks in both visual quality and medical accuracy. We hope our dataset and model can serve as a valuable resource and help catalyze further research in medical video generation. Our code and data is available at https://github.com/FreedomIntelligence/MedGen
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
27 of 32 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 367
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
15 more
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
- 2024Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Modelscited by 61
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
- 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
- 2020PANDA: A Gigapixel-level Human-centric Video Datasetcited by 45
- 2021The SARAS Endoscopic Surgeon Action Detection (ESAD) dataset: Challenges and methodscited by 38
- 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generationcited by 20
- 2021Relevance Detection in Cataract Surgery Videos by Spatio-Temporal Action Localizationcited by 15
- 2024Bora: Biomedical Generalist Video Generation Modelcited by 15
- 2024PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgerycited by 10
- 2024Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generationcited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025Fleming-VL: Towards Universal Medical Visual Reasoning with Multimodal LLMscited by 11
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
- 2026VIOLA: Towards Video In-Context Learning with Minimal Annotationscited by 2
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoningcited by 2
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulationcited by 0
- 2026ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymizationcited by 0
- 2026REMEDY: How Far Is Video Generation from Medical Education World Models?cited by 0
- 2026REMEDY: How Far Is Video Generation from Medical Education World Models?26 Sep 2026
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoning14 Aug 2026
- 2026ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization12 Jun 2026
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generation9 May 2026
- 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulation28 Feb 2026
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Calling11 Feb 2026
- 2026VIOLA: Towards Video In-Context Learning with Minimal Annotations22 Jan 2026
- 2025Fleming-VL: Towards Universal Medical Visual Reasoning with Multimodal LLMs2 Nov 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025