mlsanityData to 7 Oct 2026

3DreamBooth: High-Fidelity 3D Subject-Driven Video Generation Model

arXiv 2603.18524 ↗First posted 19 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Creating dynamic, view-consistent videos of customized subjects is highly sought after for a wide range of emerging applications, including immersive VR/AR, virtual production, and next-generation e-commerce. However, despite rapid progress in subject-driven video generation, existing methods predominantly treat subjects as 2D entities, focusing on transferring identity through single-view visual features or textual prompts. Because real-world subjects are inherently 3D, applying these 2D-centric approaches to 3D object customization reveals a fundamental limitation: they lack the comprehensive spatial priors necessary to reconstruct the 3D geometry. Consequently, when synthesizing novel views, they must rely on generating plausible but arbitrary details for unseen regions, rather than preserving the true 3D identity. Achieving genuine 3D-aware customization remains challenging due to the scarcity of multi-view video datasets. While one might attempt to fine-tune models on limited video sequences, this often leads to temporal overfitting. To resolve these issues, we introduce a novel framework for 3D-aware video customization, comprising 3DreamBooth and 3Dapter. 3DreamBooth decouples spatial geometry from temporal motion through a 1-frame optimization paradigm. By restricting updates to spatial representations, it effectively bakes a robust 3D prior into the model without the need for exhaustive video-based training. To enhance fine-grained textures and accelerate convergence, we incorporate 3Dapter, a visual conditioning module. Following single-view pre-training, 3Dapter undergoes multi-view joint optimization with the main generation branch via an asymmetrical conditioning strategy. This design allows the module to act as a dynamic selective router, querying view-specific geometric hints from a minimal reference set. Project page: https://ko-lani.github.io/3DreamBooth/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

47 of 54 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  9. 2024GPT-4o System Cardcited by 4,467
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
35 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  8. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  9. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  10. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  13. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  14. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  15. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  16. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  17. 2025VACE: All-in-One Video Creation and Editingcited by 467
  18. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  19. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  20. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  21. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  22. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
  23. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  24. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  25. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
  26. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  27. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  28. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  29. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  30. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  31. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  32. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
  33. 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Modelscited by 17
  34. 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
  35. 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generationcited by 2

Built on by

Not cited yet.