Zero-Shot Dynamic Concept Personalization with Grid-Based LoRA
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-video generation have enabled high-quality synthesis from text and image prompts. While the personalization of dynamic concepts, which capture subject-specific appearance and motion from a single video, is now feasible, most existing methods require per-instance fine-tuning, limiting scalability. We introduce a fully zero-shot framework for dynamic concept personalization in text-to-video models. Our method leverages structured 2x2 video grids that spatially organize input and output pairs, enabling the training of lightweight Grid-LoRA adapters for editing and composition within these grids. At inference, a dedicated Grid Fill module completes partially observed layouts, producing temporally coherent and identity preserving outputs. Once trained, the entire system operates in a single forward pass, generalizing to previously unseen dynamic concepts without any test-time optimization. Extensive experiments demonstrate high-quality and consistent results across a wide range of subjects beyond trained concepts and editing scenarios.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 23 Jul 2025.
Builds on
35 of 51 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
23 more
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2022Scalable Adaptive Computation for Iterative Generationcited by 195
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 191
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
- 2018ArcFace: Additive Angular Margin Loss for Deep Face Recognitioncited by 56
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 47
- 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
- 2025Dynamic Concepts Personalization from Single Videoscited by 20
- 2023NewMove: Customizing text-to-video models with novel motionscited by 18
- 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
- 2026Tuning-free Visual Effect Transfer across Videoscited by 3
- 2025Composing Concepts from Images and Videos via Concept-prompt Bindingcited by 2
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
- 2026Visual Personalization Turing Testcited by 0
- 2026Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generationcited by 0
- 2026LILAC: Layer-Wise Independent LoRAs and Cascaded Conditioning for Multi-Concept Customization of Diffusion Modelscited by 0
- 2026LILAC: Layer-Wise Independent LoRAs and Cascaded Conditioning for Multi-Concept Customization of Diffusion Models6 Jul 2026
- 2026Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation11 Jun 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Visual Personalization Turing Test30 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2025Over++: Generative Video Compositing for Layer Interaction Effects22 Dec 2025
- 2025Composing Concepts from Images and Videos via Concept-prompt Binding10 Dec 2025