Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion
Not on the map. Why?
Abstract (arXiv)
3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling style-controllable generation naturally emerges as an important and desirable direction. However, existing approaches typically rely on style images that lie within or are similar to the training distribution of 3D generation models. When presented with out-of-distribution (OOD) styles, their performance degrades significantly or even fails. To address this limitation, we introduce DiLAST: 2D Diffusion-based Latent Awakening for 3D Style Transfer. Specifically, we leverage a pretrained 2D diffusion model as a teacher to provide rich and generalizable style priors. By aligning rendered views with the target style under diffusion-based guidance, our method optimizes the structured 3D latent representations for stylization. We observe that this limitation stems not from insufficient model capacity, but from the underutilization of structured 3D latents, which are inherently expressive. Despite being trained on comparatively limited data, 3D generation models can leverage 2D diffusion guidance to steer denoising toward specific directions in latent space, thereby producing diverse, OOD styles. Extensive experiments across diverse data and multiple 3D generation backbones demonstrate the effectiveness and plug-and-play nature of our approach.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 66 of its 70 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
66 of 70 references.
References · 66
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 78
- 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representationscited by 68
- 2022Unified Implicit Neural Stylizationcited by 67
- 2024Advances in 3D Generation: A Surveycited by 62
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 51
- 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
50 most cited of 66 All 66 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Jigsaw3D: Disentangled 3D Style Transfer via Patch Shuffling and Masking
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer
- 20233DStyle-Diffusion: Pursuing Fine-grained Text-driven 3D Stylization with 2D Diffusion Models
- 2024Towards Multi-View Consistent Style Transfer with One-Step Diffusion via Vision Conditioning
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generation
- 2025FantasyStyle: Controllable Stylized Distillation for 3D Gaussian Splatting
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images
- 2026Image-Guided Geometric Stylization of 3D Meshes