mlsanityData to 7 Oct 2026

RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editing

arXiv 2608.09186 ↗First posted 10 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-driven 3D face generation and editing remains challenging due to the difficulty of translating long-form descriptions into fine-grained facial geometry. Existing methods primarily align global textual semantics with facial structures but often struggle to capture subtle local deformations, such as eyebrow tension, cheek contraction, and asymmetric mouth motions, resulting in limited geometric fidelity and editing precision. To facilitate fine-grained text-driven facial modeling, we first construct FaME-G2E, a large-scale multimodal dataset containing detailed text--mesh annotations and paired text--blendshape samples for unified 3D facial generation and editing. Based on this dataset, we propose RAGMesh, a retrieval-augmented framework that leverages text-correlated geometric priors to improve high-fidelity facial synthesis and editing. Specifically, the Multi-Scale Retrieval Fusion (MSRF) module retrieves semantically consistent global and regional facial priors and fuses them in the blendshape space, suppressing conflicting local deformations while preserving coherent deformation patterns. Furthermore, we introduce Adaptive RAG-guided Supervision (AdaRAGS), a region-aware constraint that explicitly aligns textual semantics with corresponding facial regions, enhancing regional controllability and editing accuracy. Extensive experiments on FaME-G2E demonstrate that RAGMesh achieves superior performance over state-of-the-art methods in local geometric accuracy, text-guided controllability, regional editing precision, and inference efficiency. Video demo is available at https://youtu.be/Yr0_XkpWcNk, and the source code and dataset will be released upon paper acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

38 of 49 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  5. 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
  6. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  9. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  10. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  11. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  12. 2021Internet-Augmented Dialogue Generationcited by 217
26 more
  1. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 183
  2. 2022DocPrompting: Generating Code by Retrieving the Docscited by 151
  3. 2023TADA! Text to Animatable Digital Avatarscited by 109
  4. 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
  5. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 79
  6. 2023FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusioncited by 77
  7. 20223D face reconstruction with dense landmarkscited by 70
  8. 2023Self-Knowledge Guided Retrieval Augmentation for Large Language Modelscited by 69
  9. 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
  10. 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
  11. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59
  12. 2023HeadSculpt: Crafting 3D Head Avatars with Textcited by 48
  13. 2022Retrieval-based Controllable Molecule Generationcited by 44
  14. 2022CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshescited by 41
  15. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 32
  16. 2023Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creationcited by 15
  17. 2024Retrieval-Augmented Score Distillation for Text-to-3D Generationcited by 14
  18. 2024CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussianscited by 10
  19. 2025RecDreamer: Consistent Text-to-3D Generation via Uniform Score Distillationcited by 9
  20. 20223D-TOGO: Towards Text-Guided Cross-Category 3D Object Generationcited by 8
  21. 2023Text-Guided 3D Face Synthesis -- From Generation to Editingcited by 8
  22. 2023AMD:Anatomical Motion Diffusion with Interpretable Motion Decomposition and Fusioncited by 5
  23. 2025SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillationcited by 5
  24. 2025TeRA: Rethinking Text-guided Realistic 3D Avatar Generationcited by 5
  25. 2021Generating Diverse 3D Reconstructions from a Single Occluded Face Imagecited by 4
  26. 2024Skull-to-Face: Anatomy-Guided 3D Facial Reconstruction and Editingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025T2Bs: Text-to-Character Blendshapes via Video Generation
  2. 2024Revealing Directions for Text-guided 3D Face Editing
  3. 2026EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions
  4. 2025StyleMM: Stylized 3D Morphable Face Model via Text-Driven Aligned Image Translation
  5. 2025DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
  6. 2026MMFace-DiT: A Dual-Stream Diffusion Transformer for High-Fidelity Multimodal Face Generation
  7. 2025Disentangling 3D from Large Vision-Language Models for Controlled Portrait Generation
  8. 2025MuseFace: Text-driven Face Editing via Diffusion-based Mask Generation Approach