mlsanityData to 7 Oct 2026

InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpainting

arXiv 2403.11878 ↗First posted 18 Mar 2024cs.CVcited by 22

Not on the map. Why?

Abstract (arXiv)

Text-to-texture synthesis has become a new frontier in 3D content creation thanks to the recent advances in text-to-image models. Existing methods primarily adopt a combination of pretrained depth-aware diffusion and inpainting models, yet they exhibit shortcomings such as 3D inconsistency and limited controllability. To address these challenges, we introduce InteX, a novel framework for interactive text-to-texture synthesis. 1) InteX includes a user-friendly interface that facilitates interaction and control throughout the synthesis process, enabling region-specific repainting and precise texture editing. 2) Additionally, we develop a unified depth-aware inpainting model that integrates depth information with inpainting cues, effectively mitigating 3D inconsistencies and improving generation speed. Through extensive experiments, our framework has proven to be both practical and effective in text-to-texture synthesis, paving the way for high-quality 3D content creation.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 49 of its 53 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

49 of 53 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  9. 2021Vision Transformers for Dense Predictioncited by 1,789
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
37 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  6. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  9. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  11. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  12. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  13. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  14. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  15. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  16. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  17. 2022Blended Latent Diffusioncited by 430
  18. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  19. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  20. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  21. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  22. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  23. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  24. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  25. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  26. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  27. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  28. 2023Scalable 3D Captioning with Pretrained Modelscited by 201
  29. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  30. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  31. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  32. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  33. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  34. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  35. 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
  36. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
  37. 2023MATLABER: Material-Aware Text-to-3D via LAtent BRDF auto-EncodeRcited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 11; 2026: 1.

22 papers.

Sort:

By area:

  1. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  2. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
  3. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  4. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  5. 20243DEnhancer: Consistent Multi-View Diffusion for 3D Enhancementcited by 12
  6. 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
  7. 2024Make-A-Texture: Fast Shape-Aware Texture Generation in 3 Secondscited by 11
  8. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturingcited by 10
  9. 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
  10. 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 9
  11. 2024FlexiTex: Enhancing Texture Generation via Visual Guidancecited by 8
  12. 2025Elevating 3D Models: High-Quality Texture and Geometry Refinement from a Low-Quality Modelcited by 7
10 more
  1. 2025GAP: Gaussianize Any Point Clouds with Text Guidancecited by 7
  2. 2024Jointly Generating Multi-view Consistent PBR Textures using Collaborative Controlcited by 4
  3. 2024Meta 3D Gencited by 3
  4. 2025PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Modelscited by 2
  5. 2025Track, Inpaint, Resplat: Subject-driven 3D and 4D Generation with Progressive Texture Infillingcited by 2
  6. 2025A Scalable Attention-Based Approach for Image-to-3D Texture Mappingcited by 1
  7. 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidancecited by 1
  8. 2024ConTEXTure: Consistent Multiview Images to Texturecited by 0
  9. 2025TexTailor: Customized Text-aligned Texturing via Effective Resamplingcited by 0
  10. 2025End-to-End Fine-Tuning of 3D Texture Generation using Differentiable Rewardscited by 0