mlsanityData to 7 Oct 2026

Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion

arXiv 2605.04412 ↗First posted 6 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling style-controllable generation naturally emerges as an important and desirable direction. However, existing approaches typically rely on style images that lie within or are similar to the training distribution of 3D generation models. When presented with out-of-distribution (OOD) styles, their performance degrades significantly or even fails. To address this limitation, we introduce DiLAST: 2D Diffusion-based Latent Awakening for 3D Style Transfer. Specifically, we leverage a pretrained 2D diffusion model as a teacher to provide rich and generalizable style priors. By aligning rendered views with the target style under diffusion-based guidance, our method optimizes the structured 3D latent representations for stylization. We observe that this limitation stems not from insufficient model capacity, but from the underutilization of structured 3D latents, which are inherently expressive. Despite being trained on comparatively limited data, 3D generation models can leverage 2D diffusion guidance to steer denoising toward specific directions in latent space, thereby producing diverse, OOD styles. Extensive experiments across diverse data and multiple 3D generation backbones demonstrate the effectiveness and plug-and-play nature of our approach.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 66 of its 70 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

66 of 70 references.

References · 66

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  10. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  12. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  13. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  14. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  15. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  16. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  17. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  18. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  19. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  20. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  21. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  22. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  23. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  24. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  25. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
  26. 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
  27. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  28. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  29. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  30. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
  31. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  32. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 78
  33. 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representationscited by 68
  34. 2022Unified Implicit Neural Stylizationcited by 67
  35. 2024Advances in 3D Generation: A Surveycited by 62
  36. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  37. 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 51
  38. 2023AutoDecoding Latent 3D Diffusion Modelscited by 50

50 most cited of 66 All 66 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Jigsaw3D: Disentangled 3D Style Transfer via Patch Shuffling and Masking
  2. 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer
  3. 20233DStyle-Diffusion: Pursuing Fine-grained Text-driven 3D Stylization with 2D Diffusion Models
  4. 2024Towards Multi-View Consistent Style Transfer with One-Step Diffusion via Vision Conditioning
  5. 2023Single Mesh Diffusion Models with Field Latents for Texture Generation
  6. 2025FantasyStyle: Controllable Stylized Distillation for 3D Gaussian Splatting
  7. 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images
  8. 2026Image-Guided Geometric Stylization of 3D Meshes