mlsanityData to 14 Oct 2026

ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars

arXiv 2403.15383 ↗First posted 22 Mar 2024cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Real-world applications often require a large gallery of 3D assets that share a consistent theme. While remarkable advances have been made in general 3D content creation from text or image, synthesizing customized 3D assets following the shared theme of input 3D exemplars remains an open and challenging problem. In this work, we present ThemeStation, a novel approach for theme-aware 3D-to-3D generation. ThemeStation synthesizes customized 3D assets based on given few exemplars with two goals: 1) unity for generating 3D assets that thematically align with the given exemplars and 2) diversity for generating 3D assets with a high degree of variations. To this end, we design a two-stage framework that draws a concept image first, followed by a reference-informed 3D modeling stage. We propose a novel dual score distillation (DSD) loss to jointly leverage priors from both the input exemplars and the synthesized concept image. Extensive experiments and user studies confirm that ThemeStation surpasses prior works in producing diverse theme-aware 3D models with impressive quality. ThemeStation also enables various applications such as controllable 3D-to-3D generation.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 42 of its 59 references that are in the map. First posted on arXiv 22 Mar 2024.

Builds on

42 of 59 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
30 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  5. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  6. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  7. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  8. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  9. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  10. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  11. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  12. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  13. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  14. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  15. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  16. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  17. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  18. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  19. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
  20. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  21. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  22. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 158
  23. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  24. 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
  25. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
  26. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  27. 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
  28. 2022Learning to Generate 3D Shapes from a Single Examplecited by 31
  29. 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
  30. 2023Patch-based 3D Natural Scene Generation from a Single Examplecited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 7; 2025: 3; 2026: 4.

14 papers.

Sort:

By area: