Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Text
Not on the map. Why?
Abstract (arXiv)
Creating and animating 3D biped cartoon characters is crucial and valuable in various applications. Compared with geometry, the diverse texture design plays an important role in making 3D biped cartoon characters vivid and charming. Therefore, we focus on automatic texture design for cartoon characters based on input instructions. This is challenging for domain-specific requirements and a lack of high-quality data. To address this challenge, we propose Make-It-Vivid, the first attempt to enable high-quality texture generation from text in UV space. We prepare a detailed text-texture paired data for 3D characters by using vision-question-answering agents. Then we customize a pretrained text-to-image model to generate texture map with template structure while preserving the natural 2D image knowledge. Furthermore, to enhance fine-grained details, we propose a novel adversarial learning scheme to shorten the domain gap between original dataset and realistic texture domain. Extensive experiments show that our approach outperforms current texture generation methods, resulting in efficient character texturing and faithful generation with prompts. Besides, we showcase various applications such as out of domain generation and texture stylization. We also provide an efficient generation system for automatic text-guided textured character generation and animation.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 46 of its 55 references that are in the map. First posted on arXiv 25 Mar 2024.
Builds on
46 of 55 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
34 more
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2018Demystifying MMD GANscited by 1,293
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
- 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
- 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
- 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
- 2023ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual Descriptionscited by 86
- 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
- 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 80
- 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
- 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
- 2020StyleUV: Diverse and High-fidelity UV Map Generative Modelcited by 6
- 2019Generation High resolution 3D model from natural language by Generative Adversarial Networkcited by 3
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 2.
7 papers.
- 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modelingcited by 45
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
- 2024ClotheDreamer: Text-Guided Garment Generation with 3D Gaussianscited by 9
- 2024Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusioncited by 1
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
- 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026Advances in Neural 3D Mesh Texturing: A Survey28 May 2026
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assets9 Apr 2025
- 2024Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion15 Nov 2024
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models9 Jul 2024
- 2024ClotheDreamer: Text-Guided Garment Generation with 3D Gaussians24 Jun 2024
- 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modeling28 Mar 2024