mlsanityData to 7 Oct 2026

Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors

arXiv 2403.05102 ↗First posted 8 Mar 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The recent advancements in 2D generation technology have sparked a widespread discussion on using 2D priors for 3D shape and texture content generation. However, these methods often overlook the subsequent user operations, such as texture aliasing and blurring that occur when the user acquires the 3D model and simplifies its structure. Traditional graphics methods partially alleviate this issue, but recent texture synthesis technologies fail to ensure consistency with the original model's appearance and cannot achieve high-fidelity restoration. Moreover, background noise frequently arises in high-resolution texture synthesis, limiting the practical application of these generation technologies.In this work, we propose a high-resolution and high-fidelity texture restoration technique that uses the rough texture as the initial input to enhance the consistency between the synthetic texture and the initial texture, thereby overcoming the issues of aliasing and blurring caused by the user's structure simplification operations. Additionally, we introduce a background noise smoothing technique based on a self-supervised scheme to address the noise problem in current high-resolution texture synthesis schemes. Our approach enables high-resolution texture synthesis, paving the way for high-definition and high-detail texture synthesis technology. Experiments demonstrate that our scheme outperforms currently known schemes in high-fidelity texture recovery under high-resolution conditions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 65 references that are in the map. First posted on arXiv 8 Mar 2024.

Builds on

47 of 65 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  12. 2021Volume Rendering of Neural Implicit Surfacescited by 990
35 more
  1. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  2. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  7. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  9. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  10. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  11. 2022Novel View Synthesis with Diffusion Modelscited by 299
  12. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  13. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  14. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  15. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  16. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  17. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  18. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
  19. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  20. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  21. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  22. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
  23. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  24. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  25. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
  26. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  27. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  28. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  29. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59
  30. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
  31. 2023AG3D: Learning to Generate 3D Avatars from 2D Image Collectionscited by 55
  32. 2021ClipMatrix: Text-controlled Creation of 3D Textured Meshescited by 40
  33. 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
  34. 2022ISS: Image as Stepping Stone for Text-Guided 3D Shape Generationcited by 27
  35. 2023MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texturecited by 3

Built on by

Not cited yet.