mlsanityData to 7 Oct 2026

Slot-ID: Identity-Preserving Video Generation from Reference Videos via Slot-Based Temporal Identity Encoding

arXiv 2601.01352 ↗First posted 4 Jan 2026cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Human identity-preserving text-to-video generation remains challenging under large changes in viewpoint, facial expression, illumination, and motion. Existing methods condition the generator on a single reference portrait, but a static image cannot capture how identity-bearing cues evolve across views and expressions, leading to face deformation, pose locking, identity drift, or over-smoothed faces. We observe that a short reference clip naturally provides richer temporal and multi-view identity cues than any single image, motivating a video-referential formulation. This richer signal, however, introduces a new challenge: identity evidence is distributed across many frames and must be distilled into a compact, stable representation under a limited token budget. To this end, we propose Slot-ID, a lightweight identity-conditioning framework built on a frozen text-to-video backbone. Slot-ID employs a slot-based temporal identity encoder with Sinkhorn-routed iterative reading to distill a compact, stable set of identity tokens from the reference clip, complemented by an image-anchor stream for dual-source conditioning. Extensive experiments demonstrate that Slot-ID outperforms state-of-the-art methods in identity preservation and visual naturalness while remaining competitive in prompt following, with particularly large gains under challenging pose, expression, and motion variations.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

48 of 66 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  9. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
36 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  3. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  5. 2018Computational Optimal Transportcited by 765
  6. 2020First Order Motion Model for Image Animationcited by 698
  7. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  8. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  9. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  10. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  11. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  12. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  13. 2024LoRA Learns Less and Forgets Lesscited by 313
  14. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  15. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
  16. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  17. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  18. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  19. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  20. 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 153
  21. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  22. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  23. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  24. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
  25. 2024Multi-LoRA Composition for Image Generationcited by 80
  26. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  27. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
  28. 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
  29. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  30. 2024Motion Inversion for Video Customizationcited by 30
  31. 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 27
  32. 2023NewMove: Customizing text-to-video models with novel motionscited by 18
  33. 2024Conditional LoRA Parameter Generationcited by 16
  34. 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
  35. 2023Edit Temporal-Consistent Videos with Image Diffusion Modelcited by 11
  36. 2023Filter-Guided Diffusion for Controllable Image Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.