mlsanityData to 14 Oct 2026

TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition

arXiv 2210.11277 ↗First posted 20 Oct 2022cs.CV cs.AIcited by 83

Not on the map. Why?

Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Creation of 3D content by stylization is a promising yet challenging problem in computer vision and graphics research. In this work, we focus on stylizing photorealistic appearance renderings of a given surface mesh of arbitrary topology. Motivated by the recent surge of cross-modal supervision of the Contrastive Language-Image Pre-training (CLIP) model, we propose TANGO, which transfers the appearance style of a given 3D shape according to a text prompt in a photorealistic manner. Technically, we propose to disentangle the appearance style as the spatially varying bidirectional reflectance distribution function, the local geometric variation, and the lighting condition, which are jointly optimized, via supervision of the CLIP loss, by a spherical Gaussians based differentiable renderer. As such, TANGO enables photorealistic 3D style transfer by automatically predicting reflectance effects even for bare, low-quality meshes, without training on a task-specific dataset. Extensive experiments show that TANGO outperforms existing methods of text-driven 3D style transfer in terms of photorealistic quality, consistency of 3D geometry, and robustness when stylizing low-quality meshes. Our codes and results are available at our project webpage https://cyw-3d.github.io/tango/.

Key facts. Cited by 83 papers in the map (data through 14 Oct 2026). Builds on 32 of its 64 references that are in the map. First posted on arXiv 20 Oct 2022.

Builds on

32 of 64 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  6. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  7. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  8. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  9. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  10. 2017Neural 3D Mesh Renderercited by 437
  11. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  12. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
20 more
  1. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  2. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  3. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  4. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  5. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  6. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  7. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  8. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  9. 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 183
  10. 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
  11. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  12. 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
  13. 2020Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Renderingcited by 101
  14. 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
  15. 2021DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderercited by 52
  16. 2020Deep Geometric Texture Synthesiscited by 51
  17. 2020Neural Subdivisioncited by 49
  18. 2021ClipMatrix: Text-controlled Creation of 3D Textured Meshescited by 40
  19. 2021Exemplar-Based 3D Portrait Stylizationcited by 21
  20. 2021Image2Lego: Customized LEGO Set Generation from Imagescited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 36; 2024: 31; 2025: 11; 2026: 3.

83 papers.

Sort:

By area:

  1. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  2. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  3. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  4. 2023Text-to-3D using Gaussian Splattingcited by 299
  5. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  6. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  7. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  8. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  9. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  10. 2023TADA! Text to Animatable Digital Avatarscited by 110
  11. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 98
  12. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
38 more
  1. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
  2. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
  3. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  4. 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
  5. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  6. 2024Advances in 3D Generation: A Surveycited by 63
  7. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
  8. 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
  9. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
  10. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
  11. 2023HeadSculpt: Crafting 3D Head Avatars with Textcited by 49
  12. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Modelscited by 45
  13. 2023Text-Guided Generation and Editing of Compositional 3D Avatarscited by 39
  14. 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
  15. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  16. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 35
  17. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  18. 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 33
  19. 2023Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Priorcited by 32
  20. 2023GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noisecited by 30
  21. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
  22. 2023Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fieldscited by 28
  23. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  24. 2024MaPa: Text-driven Photorealistic Material Painting for 3D Shapescited by 27
  25. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resamplingcited by 24
  26. 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Modelscited by 22
  27. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  28. 2023Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Detailscited by 18
  29. 2024GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Qualitycited by 18
  30. 2023EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generationcited by 16
  31. 2023InstructP2P: Learning to Edit 3D Point Clouds with Text Instructionscited by 14
  32. 2023TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshescited by 14
  33. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpaintingcited by 14
  34. 2023Mesh Neural Cellular Automatacited by 11
  35. 2024SIGNeRF: Scene Integrated Generation for Neural Radiance Fieldscited by 11
  36. 2024Boosting 3D Object Generation through PBR Materialscited by 10
  37. 2023Advances in 3D Neural Stylization: A Surveycited by 8
  38. 2024VCD-Texture: Variance Alignment based 3D-2D Co-Denoising for Text-Guided Texturingcited by 8

50 most cited of 83 All 83 (JSON)