ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars
Not on the map. Why?
Abstract (arXiv)
Real-world applications often require a large gallery of 3D assets that share a consistent theme. While remarkable advances have been made in general 3D content creation from text or image, synthesizing customized 3D assets following the shared theme of input 3D exemplars remains an open and challenging problem. In this work, we present ThemeStation, a novel approach for theme-aware 3D-to-3D generation. ThemeStation synthesizes customized 3D assets based on given few exemplars with two goals: 1) unity for generating 3D assets that thematically align with the given exemplars and 2) diversity for generating 3D assets with a high degree of variations. To this end, we design a two-stage framework that draws a concept image first, followed by a reference-informed 3D modeling stage. We propose a novel dual score distillation (DSD) loss to jointly leverage priors from both the input exemplars and the synthesized concept image. Extensive experiments and user studies confirm that ThemeStation surpasses prior works in producing diverse theme-aware 3D models with impressive quality. ThemeStation also enables various applications such as controllable 3D-to-3D generation.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 42 of its 59 references that are in the map. First posted on arXiv 22 Mar 2024.
Builds on
42 of 59 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
30 more
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 158
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2022Learning to Generate 3D Shapes from a Single Examplecited by 31
- 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
- 2023Patch-based 3D Natural Scene Generation from a Single Examplecited by 15
Built on by
Citing papers per year: 2024: 7; 2025: 3; 2026: 4.
14 papers.
Sort:
By area:
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
- 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
- 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusioncited by 19
- 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generationcited by 16
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Promptcited by 8
- 2025StyleSculptor: Zero-Shot Style-Controllable 3D Asset Generation with Texture-Geometry Dual Guidancecited by 8
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentationcited by 6
- 2026PEGAsus: 3D Personalization of Geometry and Appearancecited by 5
- 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generationcited by 2
- 2026UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-Attention Routingcited by 2
- 2026DiDE:Direct Injection with Color-Texture DEcoupling for 3D Stylization1 Oct 2026
- 2026UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-Attention Routing27 Jul 2026
- 2026PEGAsus: 3D Personalization of Geometry and Appearance9 Feb 2026
- 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generation29 Jan 2026
- 2025StyleSculptor: Zero-Shot Style-Controllable 3D Asset Generation with Texture-Geometry Dual Guidance16 Sep 2025
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Models27 Mar 2025
- 2025Parameter-Efficient Fine-Tuning for Foundation Models23 Jan 2025
- 2024ExCellGen: Fast, Controllable, Photorealistic 3D Scene Generation from a Single Real-World Exemplar20 Dec 2024
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation12 Dec 2024
- 2024Material Anything: Generating Materials for Any 3D Object via Diffusion22 Nov 2024
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Prompt16 Oct 2024
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion17 Sep 2024
2 more
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
- 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusioncited by 19
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Promptcited by 8
- 2025StyleSculptor: Zero-Shot Style-Controllable 3D Asset Generation with Texture-Geometry Dual Guidancecited by 8
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentationcited by 6
- 2026PEGAsus: 3D Personalization of Geometry and Appearancecited by 5
- 2026UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-Attention Routingcited by 2
- 2024ExCellGen: Fast, Controllable, Photorealistic 3D Scene Generation from a Single Real-World Exemplarcited by 0
- 2026UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-Attention Routing27 Jul 2026
- 2026PEGAsus: 3D Personalization of Geometry and Appearance9 Feb 2026
- 2025StyleSculptor: Zero-Shot Style-Controllable 3D Asset Generation with Texture-Geometry Dual Guidance16 Sep 2025
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Models27 Mar 2025
- 2025Parameter-Efficient Fine-Tuning for Foundation Models23 Jan 2025
- 2024ExCellGen: Fast, Controllable, Photorealistic 3D Scene Generation from a Single Real-World Exemplar20 Dec 2024
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation12 Dec 2024
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Prompt16 Oct 2024
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion17 Sep 2024
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Models31 May 2024