TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment
Not on the map. Why?
Abstract (arXiv)
Modern face reenactment systems achieve impressive pose and expression transfer using geometry-driven representations. However, they largely ignore tongue dynamics, leading to anatomically inconsistent mouth interiors during speech and expressive motions. We introduce the first framework for cross-identity tongue dynamics transfer in face reenactment. We propose a foundation-model-assisted bootstrapping pipeline that produces a dedicated tongue segmentation model for in-the-wild reenactment without curated annotations. We further introduce a spatially constrained latent masked diffusion model for realistic tongue synthesis, with adaptive mask dilation for seamless mouth boundary transitions. Extensive experiments demonstrate improvements of more than two times over all baselines on every tongue-specific metric. We additionally propose a VLM-based evaluation protocol that replicates expert annotation at scale, confirming perceptual superiority across all ablation variants.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
27 of 32 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
15 more
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
- 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 33
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
- 2023TongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shotcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
- 2025SyncAnyone: Implicit Disentanglement via Progressive Self-Correction for Lip-Syncing in the wild
- 2026AudioFace: Language-Assisted Speech-Driven Facial Animation with Multimodal Language Models
- 2024High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model
- 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment
- 2026MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation
- 2025IMTalker: Efficient Audio-driven Talking Face Generation with Implicit Motion Transfer
- 2025Navigating Large-Pose Challenge for High-Fidelity Face Reenactment with Video Diffusion Model