ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Text-to-video generation has advanced rapidly, yet preserving a character's holistic appearance from a single reference image remains challenging, particularly when the character undergoes large pose, motion, and scene changes. Existing reference-conditioned approaches primarily treat the reference image as a conditioning signal, which can weaken fine-grained appearance information as reference and noisy video tokens interact during denoising. We propose ContextAnyone, a context-aware diffusion framework that instead treats the reference as an explicitly preserved appearance anchor. Our key idea is to jointly reconstruct the reference image and generate the target video within a shared diffusion transformer, providing direct supervision for preserving identity and fine-grained appearance throughout denoising. To maintain the reference as a stable source of appearance information, we further introduce asymmetric information flow that allows video tokens to selectively access reference tokens while preventing noisy video features from propagating back to the reference branch. We complement this design with Gap-RoPE, which separates the positional representations of the reference and generated video tokens. Experiments on a benchmark constructed from OpenVid-HD demonstrate that ContextAnyone improves both identity and fine-grained appearance consistency over existing reference-conditioned baselines while maintaining motion characteristics close to the underlying text-to-video generator.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 43 of its 49 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
43 of 49 references.
References · 43
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
31 more
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
- 2025Multi-subject Open-set Personalization in Video Generationcited by 66
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
- 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 29
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2025OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditionscited by 17
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 9
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generationcited by 4
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation18 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025BachVid: Training-Free Video Generation with Consistent Background and Character
- 2024Contextualized Diffusion Models for Text-Guided Image and Video Generation
- 2023VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation
- 2024Video Diffusion Transformers are In-Context Learners
- 2024Consistent Human Image and Video Generation with Spatially Conditioned Diffusion
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models