Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors
Not on the map. Why?
Abstract (arXiv)
The recent advancements in 2D generation technology have sparked a widespread discussion on using 2D priors for 3D shape and texture content generation. However, these methods often overlook the subsequent user operations, such as texture aliasing and blurring that occur when the user acquires the 3D model and simplifies its structure. Traditional graphics methods partially alleviate this issue, but recent texture synthesis technologies fail to ensure consistency with the original model's appearance and cannot achieve high-fidelity restoration. Moreover, background noise frequently arises in high-resolution texture synthesis, limiting the practical application of these generation technologies.In this work, we propose a high-resolution and high-fidelity texture restoration technique that uses the rough texture as the initial input to enhance the consistency between the synthetic texture and the initial texture, thereby overcoming the issues of aliasing and blurring caused by the user's structure simplification operations. Additionally, we introduce a background noise smoothing technique based on a self-supervised scheme to address the noise problem in current high-resolution texture synthesis schemes. Our approach enables high-resolution texture synthesis, paving the way for high-definition and high-detail texture synthesis technology. Experiments demonstrate that our scheme outperforms currently known schemes in high-fidelity texture recovery under high-resolution conditions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 65 references that are in the map. First posted on arXiv 8 Mar 2024.
Builds on
47 of 65 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
35 more
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59
- 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
- 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
- 2021ClipMatrix: Text-controlled Creation of 3D Textured Meshescited by 40
- 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
- 2022ISS: Image as Stepping Stone for Text-Guided 3D Shape Generationcited by 27
- 2023MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texturecited by 3
Built on by
Not cited yet.