Phantom-Data : Towards a General Subject-Consistent Video Generation Dataset
Not on the map. Why?
Abstract (arXiv)
Subject-to-video generation has witnessed substantial progress in recent years. However, existing models still face significant challenges in faithfully following textual instructions. This limitation, commonly known as the copy-paste problem, arises from the widely used in-pair training paradigm. This approach inherently entangles subject identity with background and contextual attributes by sampling reference images from the same scene as the target video. To address this issue, we introduce Phantom-Data, the first general-purpose cross-pair subject-to-video consistency dataset, containing approximately one million identity-consistent pairs across diverse categories. Our dataset is constructed via a three-stage pipeline: (1) a general and input-aligned subject detection module, (2) large-scale cross-context subject retrieval from more than 53 million videos and 3 billion images, and (3) prior-guided identity verification to ensure visual consistency under contextual variation. Comprehensive experiments show that training with Phantom-Data significantly improves prompt alignment and visual quality while preserving identity consistency on par with in-pair baselines.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 44 of its 47 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
44 of 47 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
32 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2023Demystifying CLIP Datacited by 270
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
- 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
- 2025Multi-subject Open-set Personalization in Video Generationcited by 66
- 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
- 2025Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Promptscited by 29
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
Built on by
Citing papers per year: 2025: 2; 2026: 15.
17 papers.
Sort:
By area:
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 47
- 2026SkyReels-V3 Technique Reportcited by 20
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editingcited by 6
- 2026Identity-Consistent Video Generation under Large Facial-Angle Variationscited by 3
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generationcited by 3
- 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generationcited by 2
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
5 more
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editingcited by 1
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generationcited by 0
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing30 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing4 Jun 2026
- 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation22 May 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026Identity-Consistent Video Generation under Large Facial-Angle Variations22 Mar 2026
- 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generation13 Mar 2026
5 more
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
- 2026MV-S2V: Multi-View Subject-Consistent Video Generation25 Jan 2026
- 2026SkyReels-V3 Technique Report24 Jan 2026
- 2025Scaling Zero-Shot Reference-to-Video Generation7 Dec 2025
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning10 Sep 2025
- 2026SkyReels-V3 Technique Reportcited by 20
- 2026SkyReels-V3 Technique Report24 Jan 2026
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 47
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editingcited by 6
- 2026Identity-Consistent Video Generation under Large Facial-Angle Variationscited by 3
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generationcited by 3
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
12 most cited of 15 All 15 (JSON)
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing30 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing4 Jun 2026
- 2026EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation22 May 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026Identity-Consistent Video Generation under Large Facial-Angle Variations22 Mar 2026
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
12 newest of 15 All 15 (JSON)