mlsanityData to 7 Oct 2026

Does Native 3D Texture Generation Necessarily Require 3D Assets for Training?

arXiv 2609.34621 ↗First posted 28 Sep 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Native 3D texture generation synthesizes colors directly in 3D space for a given geometry, conditioned on multi-view reference images. It is generally believed that training such models requires large-scale, high-quality real 3D asset data, whose acquisition remains a long-standing and challenging problem. In this work, we propose Tex-Zero, demonstrating that a high-fidelity native 3D texture generation framework can be trained without 3D assets. Our key observation is that only high-quality and fine-grained color information is essential for 3D texture training, while the required geometric information is less critical and can be manually constructed rather than obtained from real 3D assets. This finding makes it possible to transform abundant, high-quality 2D images into effective training samples for 3D texture generation. Specifically, we convert high-quality 2D images into 3D training samples by representing each image as a plane in 3D space and applying patch-wise random rotations and aggregation to construct complex geometric structures. Using these constructed image data, we train the Tex-Zero VAE, which can reconstruct real 3D assets with high quality despite never observing them during training. Building upon the Tex-Zero VAE, we train the Tex-Zero DiT also exclusively on the constructed image data, where the conditioning 2D multi-view images are transformed into planes in 3D space and also encoded by the Tex-Zero VAE, thereby reducing the representation gap and improving generation quality. Extensive experiments show that Tex-Zero generates high-fidelity 3D textures with fine-grained details solely using images as training data, offering a promising perspective on the data paradigm for scaling 3D texture generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 27 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

25 of 27 references.

References · 25

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Segment Anythingcited by 8,158
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2025Qwen-Image Technical Reportcited by 973
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  6. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  7. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  8. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  9. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  10. 2025Native and Compact Structured Latents for 3D Generationcited by 157
  11. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  12. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
13 more
  1. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  2. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 51
  3. 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
  4. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  5. 2024MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3Dcited by 34
  6. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  7. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  8. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resamplingcited by 24
  9. 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
  10. 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
  11. 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
  12. 2025LaFiTe: A Generative Latent Field for 3D Native Texturingcited by 4
  13. 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.