mlsanityData to 14 Oct 2026

3D PixBrush: Image-Guided Local Texture Synthesis

arXiv 2507.03731 ↗First posted 4 Jul 2025cs.GR cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

We present 3D PixBrush, a method for performing image-driven edits of local regions on 3D meshes. 3D PixBrush predicts a localization mask and a synthesized texture that faithfully portray the object in the reference image. Our predicted localizations are both globally coherent and locally precise. Globally - our method contextualizes the object in the reference image and automatically positions it onto the input mesh. Locally - our method produces masks that conform to the geometry of the reference image. Notably, our method does not require any user input (in the form of scribbles or bounding boxes) to achieve accurate localizations. Instead, our method predicts a localization mask on the 3D mesh from scratch. To achieve this, we propose a modification to the score distillation sampling technique which incorporates both the predicted localization and the reference image, referred to as localization-modulated image guidance. We demonstrate the effectiveness of our proposed technique on a wide variety of meshes and images.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 63 of its 69 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

63 of 69 references.

References · 63

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
38 more
  1. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  3. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  4. 2018On the Spectral Bias of Neural Networkscited by 1,341
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  6. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  10. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  11. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  12. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  13. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  14. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  15. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  16. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  17. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  18. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  19. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  20. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  21. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  22. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  23. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  24. 2022ARF: Artistic Radiance Fieldscited by 147
  25. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  26. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  27. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  28. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  29. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  30. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
  31. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  32. 2022Unified Implicit Neural Stylizationcited by 67
  33. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  34. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  35. 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
  36. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
  37. 2020Deep Geometric Texture Synthesiscited by 51
  38. 2020Neural Subdivisioncited by 49

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Best Segmentation Buddies for Image-Shape Correspondencecited by 0
  2. 2026ES3D: Embedding Semantics into 3D Space for Component-Aware Editingcited by 0
  3. 2026DynaMesh: Dynamic 3D Texture Generationcited by 0