mlsanityData to 14 Oct 2026

Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Text

arXiv 2403.16897 ↗First posted 25 Mar 2024cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Creating and animating 3D biped cartoon characters is crucial and valuable in various applications. Compared with geometry, the diverse texture design plays an important role in making 3D biped cartoon characters vivid and charming. Therefore, we focus on automatic texture design for cartoon characters based on input instructions. This is challenging for domain-specific requirements and a lack of high-quality data. To address this challenge, we propose Make-It-Vivid, the first attempt to enable high-quality texture generation from text in UV space. We prepare a detailed text-texture paired data for 3D characters by using vision-question-answering agents. Then we customize a pretrained text-to-image model to generate texture map with template structure while preserving the natural 2D image knowledge. Furthermore, to enhance fine-grained details, we propose a novel adversarial learning scheme to shorten the domain gap between original dataset and realistic texture domain. Extensive experiments show that our approach outperforms current texture generation methods, resulting in efficient character texturing and faithful generation with prompts. Besides, we showcase various applications such as out of domain generation and texture stylization. We also provide an efficient generation system for automatic text-guided textured character generation and animation.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 46 of its 55 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

46 of 55 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2022Generative Adversarial Networkscited by 5,627
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  11. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
34 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  3. 2018Demystifying MMD GANscited by 1,293
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  6. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  7. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  8. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  9. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  10. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  11. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  12. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  13. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  14. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  15. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  16. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  17. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
  18. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  19. 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
  20. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  21. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  22. 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
  23. 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
  24. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
  25. 2023ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual Descriptionscited by 86
  26. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  27. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 80
  28. 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
  29. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
  30. 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
  31. 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
  32. 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
  33. 2020StyleUV: Diverse and High-fidelity UV Map Generative Modelcited by 6
  34. 2019Generation High resolution 3D model from natural language by Generative Adversarial Networkcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 1; 2026: 2.

7 papers.