mlsanityData to 14 Oct 2026

Phantom-Data : Towards a General Subject-Consistent Video Generation Dataset

arXiv 2506.18851 ↗First posted 23 Jun 2025cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

Subject-to-video generation has witnessed substantial progress in recent years. However, existing models still face significant challenges in faithfully following textual instructions. This limitation, commonly known as the copy-paste problem, arises from the widely used in-pair training paradigm. This approach inherently entangles subject identity with background and contextual attributes by sampling reference images from the same scene as the target video. To address this issue, we introduce Phantom-Data, the first general-purpose cross-pair subject-to-video consistency dataset, containing approximately one million identity-consistent pairs across diverse categories. Our dataset is constructed via a three-stage pipeline: (1) a general and input-aligned subject detection module, (2) large-scale cross-context subject retrieval from more than 53 million videos and 3 billion images, and (3) prior-guided identity verification to ensure visual consistency under contextual variation. Comprehensive experiments show that training with Phantom-Data significantly improves prompt alignment and visual quality while preserving identity consistency on par with in-pair baselines.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 44 of its 47 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

44 of 47 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
32 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  5. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  6. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  7. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  10. 2025Improving Video Generation with Human Feedbackcited by 284
  11. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  12. 2023Demystifying CLIP Datacited by 270
  13. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
  14. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  15. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  16. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  17. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  18. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  19. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
  20. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  21. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
  22. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
  23. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
  24. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  25. 2025Multi-subject Open-set Personalization in Video Generationcited by 66
  26. 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
  27. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
  28. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
  29. 2025Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Promptscited by 29
  30. 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
  31. 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
  32. 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 15.

17 papers.

Sort:

By area:

  1. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 47
  2. 2026SkyReels-V3 Technique Reportcited by 20
  3. 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
  4. 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
  5. 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
  6. 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
  7. 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editingcited by 6
  8. 2026Identity-Consistent Video Generation under Large Facial-Angle Variationscited by 3
  9. 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
  10. 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generationcited by 3
  11. 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generationcited by 2
  12. 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
5 more
  1. 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
  2. 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
  3. 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editingcited by 1
  4. 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
  5. 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generationcited by 0