Slot-ID: Identity-Preserving Video Generation from Reference Videos via Slot-Based Temporal Identity Encoding
Not on the map. Why?
Abstract (arXiv)
Human identity-preserving text-to-video generation remains challenging under large changes in viewpoint, facial expression, illumination, and motion. Existing methods condition the generator on a single reference portrait, but a static image cannot capture how identity-bearing cues evolve across views and expressions, leading to face deformation, pose locking, identity drift, or over-smoothed faces. We observe that a short reference clip naturally provides richer temporal and multi-view identity cues than any single image, motivating a video-referential formulation. This richer signal, however, introduces a new challenge: identity evidence is distributed across many frames and must be distilled into a compact, stable representation under a limited token budget. To this end, we propose Slot-ID, a lightweight identity-conditioning framework built on a frozen text-to-video backbone. Slot-ID employs a slot-based temporal identity encoder with Sinkhorn-routed iterative reading to distill a compact, stable set of identity tokens from the reference clip, complemented by an image-anchor stream for dual-source conditioning. Extensive experiments demonstrate that Slot-ID outperforms state-of-the-art methods in identity preservation and visual naturalness while remaining competitive in prompt following, with particularly large gains under challenging pose, expression, and motion variations.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
48 of 66 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
36 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2018Computational Optimal Transportcited by 765
- 2020First Order Motion Model for Image Animationcited by 698
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2024LoRA Learns Less and Forgets Lesscited by 313
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 153
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
- 2024Motion Inversion for Video Customizationcited by 30
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 27
- 2023NewMove: Customizing text-to-video models with novel motionscited by 18
- 2024Conditional LoRA Parameter Generationcited by 16
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
- 2023Edit Temporal-Consistent Videos with Image Diffusion Modelcited by 11
- 2023Filter-Guided Diffusion for Controllable Image Generationcited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Generate Your Talking Avatar from Video Referencecited by 0
- 2026Avatar V: Scaling Video-Reference Avatar Video Generationcited by 0
- 2026BEACON: Behavior and Appearance Control for Subject-Specific Video Generationcited by 0
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generationcited by 0
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026BEACON: Behavior and Appearance Control for Subject-Specific Video Generation7 Sep 2026
- 2026Avatar V: Scaling Video-Reference Avatar Video Generation11 Jun 2026
- 2026Generate Your Talking Avatar from Video Reference30 Apr 2026