A Scalable Attention-Based Approach for Image-to-3D Texture Mapping
Not on the map. Why?
Abstract (arXiv)
High-quality textures are critical for realistic 3D content creation, yet existing generative methods are slow, rely on UV maps, and often fail to remain faithful to a reference image. To address these challenges, we propose a transformer-based framework that predicts a 3D texture field directly from a single image and a mesh, eliminating the need for UV mapping and differentiable rendering, and enabling faster texture generation. Our method integrates a triplane representation with depth-based backprojection losses, enabling efficient training and faster inference. Once trained, it generates high-fidelity textures in a single forward pass, requiring only 0.2s per shape. Extensive qualitative, quantitative, and user preference evaluations demonstrate that our method outperforms state-of-the-art baselines on single-image texture reconstruction in terms of both fidelity to the input image and perceptual quality, highlighting its practicality for scalable, high-quality, and controllable 3D content creation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 5 Sep 2025.
Builds on
31 of 47 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
19 more
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
- 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
- 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
- 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
- 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resamplingcited by 24
- 2024InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpaintingcited by 22
- 2024EASI-Tex: Edge-Aware Mesh Texturing from Single Imagecited by 20
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.