mlsanityData to 14 Oct 2026

Zero-Shot Dynamic Concept Personalization with Grid-Based LoRA

arXiv 2507.17963 ↗First posted 23 Jul 2025cs.GR cs.CV cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Recent advances in text-to-video generation have enabled high-quality synthesis from text and image prompts. While the personalization of dynamic concepts, which capture subject-specific appearance and motion from a single video, is now feasible, most existing methods require per-instance fine-tuning, limiting scalability. We introduce a fully zero-shot framework for dynamic concept personalization in text-to-video models. Our method leverages structured 2x2 video grids that spatially organize input and output pairs, enabling the training of lightweight Grid-LoRA adapters for editing and composition within these grids. At inference, a dedicated Grid Fill module completes partially observed layouts, producing temporally coherent and identity preserving outputs. Once trained, the entire system operates in a single forward pass, generalizing to previously unseen dynamic concepts without any test-time optimization. Extensive experiments demonstrate high-quality and consistent results across a wide range of subjects beyond trained concepts and editing scenarios.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 23 Jul 2025.

Builds on

35 of 51 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
23 more
  1. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  2. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  3. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  4. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  5. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  8. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  9. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  10. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  11. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  12. 2022Scalable Adaptive Computation for Iterative Generationcited by 195
  13. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 191
  14. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
  15. 2024In-Context LoRA for Diffusion Transformerscited by 158
  16. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  17. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
  18. 2018ArcFace: Additive Angular Margin Loss for Deep Face Recognitioncited by 56
  19. 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 47
  20. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
  21. 2025Dynamic Concepts Personalization from Single Videoscited by 20
  22. 2023NewMove: Customizing text-to-video models with novel motionscited by 18
  23. 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.