mlsanityData to 7 Oct 2026

3D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillation

arXiv 2311.09571 ↗First posted 16 Nov 2023cs.GR cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

In this work we develop 3D Paintbrush, a technique for automatically texturing local semantic regions on meshes via text descriptions. Our method is designed to operate directly on meshes, producing texture maps which seamlessly integrate into standard graphics pipelines. We opt to simultaneously produce a localization map (to specify the edit region) and a texture map which conforms to it. This synergistic approach improves the quality of both the localization and the stylization. To enhance the details and resolution of the textured area, we leverage multiple stages of a cascaded diffusion model to supervise our local editing technique with generative priors learned from images at different resolutions. Our technique, referred to as Cascaded Score Distillation (CSD), simultaneously distills scores at multiple resolutions in a cascaded fashion, enabling control over both the granularity and global understanding of the supervision. We demonstrate the effectiveness of 3D Paintbrush to locally texture a variety of shapes within different semantic regions. Project page: https://threedle.github.io/3d-paintbrush

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 59 of its 69 references that are in the map. First posted on arXiv 16 Nov 2023.

Builds on

59 of 69 references.

References · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  9. 2018On the Spectral Bias of Neural Networkscited by 1,321
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
38 more
  1. 2021Grounded Language-Image Pre-trainingcited by 1,147
  2. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  3. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  6. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  7. 2023LERF: Language Embedded Radiance Fieldscited by 538
  8. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  9. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  10. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  11. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  12. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  13. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  14. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  15. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  16. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  17. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  18. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  19. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  20. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 195
  21. 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 182
  22. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  23. 2022ARF: Artistic Radiance Fieldscited by 147
  24. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  25. 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
  26. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
  27. 2022Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Modelscited by 95
  28. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  29. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  30. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  31. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
  32. 2022Unified Implicit Neural Stylizationcited by 67
  33. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  34. 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
  35. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  36. 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
  37. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
  38. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 12; 2025: 12; 2026: 10.

34 papers.

Sort:

By area:

  1. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  2. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
  3. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  4. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  5. 2025Efficient Diffusion Models: A Surveycited by 35
  6. 2024Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversioncited by 27
  7. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
  8. 2024Garment3DGen: 3D Garment Stylization and Texture Generationcited by 26
  9. 2025LL3M: Large Language 3D Modelerscited by 18
  10. 2024MeshUp: Multi-Target Mesh Deformation via Blended Score Distillationcited by 17
  11. 2024iSeg: Interactive 3D Segmentation via Interactive Attentioncited by 14
  12. 2025Geometry in Style: 3D Stylization via Surface Normal Deformationcited by 14
22 more
  1. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  2. 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
  3. 2025ASIA: Adaptive 3D Segmentation using Few Image Annotationscited by 6
  4. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 5
  5. 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editingcited by 4
  6. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  7. 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
  8. 2025Im2SurfTex: Surface Texture Generation via Neural Backprojection of Multi-View Imagescited by 3
  9. 2025Voxify3D: Pixel Art Meets Volumetric Renderingcited by 3
  10. 2026Vinedresser3D: Agentic Text-guided 3D Editingcited by 3
  11. 2024Consistency^2: Consistent and Fast 3D Painting with Latent Consistency Modelscited by 2
  12. 2024CRAFT: Designing Creative and Functional 3D Objectscited by 2
  13. 20253D PixBrush: Image-Guided Local Texture Synthesiscited by 2
  14. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
  15. 2025Text2VDM: Text to Vector Displacement Maps for Expressive and Interactive 3D Sculptingcited by 1
  16. 2025Towards Generalized and Training-Free Text-Guided Semantic Manipulationcited by 1
  17. 2026ScribbleSense: Generative Scribble-Based Texture Editing with Intent Predictioncited by 1
  18. 2026Best Segmentation Buddies for Image-Shape Correspondencecited by 0
  19. 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Controlcited by 0
  20. 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
  21. 2026RADmesh: Remesh-Aware Mesh Deformationcited by 0
  22. 2026GLOSS: Geometric Local Self-Similarity Learning for Faithful Reference-Guided Texture Fillcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Semantic Score Distillation Sampling for Compositional Text-to-3D Generation
  2. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models
  3. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation
  4. 2023PaintHuman: Towards High-fidelity Text-to-3D Human Texturing via Denoised Score Distillation
  5. 2023EucliDreamer: Fast and High-Quality Texturing for 3D Models with Stable Diffusion Depth
  6. 2024EucliDreamer: Fast and High-Quality Texturing for 3D Models with Depth-Conditioned Stable Diffusion
  7. 2023Single Mesh Diffusion Models with Field Latents for Texture Generation
  8. 2024MaPa: Text-driven Photorealistic Material Painting for 3D Shapes