BridgeIV: Bridging Customized Image and Video Generation through Test-Time Autoregressive Identity Propagation
Not on the map. Why?
Abstract (arXiv)
Both zero-shot and tuning-based customized text-to-image (CT2I) generation have made significant progress for storytelling content creation. In contrast, research on customized text-to-video (CT2V) generation remains relatively limited. Existing zero-shot CT2V methods suffer from poor generalization, while another line of work directly combining tuning-based T2I models with temporal motion modules often leads to the loss of structural and texture information. To bridge this gap, we propose an autoregressive structure and texture propagation module (STPM), which extracts key structural and texture features from the reference subject and injects them autoregressively into each video frame to enhance consistency. Additionally, we introduce a test-time reward optimization (TTRO) method to further refine fine-grained details. Quantitative and qualitative experiments validate the effectiveness of STPM and TTRO, demonstrating improvements of 7.8 and 13.1 in CLIP-I and DINO consistency metrics over the baseline, respectively.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 54 references that are in the map. First posted on arXiv 11 May 2025.
Builds on
50 of 54 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
38 more
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
- 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2022Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondencecited by 32
- 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
- 2023ViCo: Plug-and-play Visual Condition for Personalized Text-to-image Generationcited by 23
- 2023DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidancecited by 20
- 2024Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenescited by 14
- 2024EasyControl: Transfer ControlNet to Video Diffusion for Controllable Generation and Interpolationcited by 12
- 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformerscited by 11
- 2024A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Modelcited by 8
Built on by
Not cited yet.