mlsanityData to 7 Oct 2026

TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment

arXiv 2607.28039 ↗First posted 30 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern face reenactment systems achieve impressive pose and expression transfer using geometry-driven representations. However, they largely ignore tongue dynamics, leading to anatomically inconsistent mouth interiors during speech and expressive motions. We introduce the first framework for cross-identity tongue dynamics transfer in face reenactment. We propose a foundation-model-assisted bootstrapping pipeline that produces a dedicated tongue segmentation model for in-the-wild reenactment without curated annotations. We further introduce a spatially constrained latent masked diffusion model for realistic tongue synthesis, with adaptive mask dilation for seamless mouth boundary transitions. Extensive experiments demonstrate improvements of more than two times over all baselines on every tongue-specific metric. We additionally propose a VLM-based evaluation protocol that replicates expert annotation at scale, confirming perceptual superiority across all ablation variants.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

27 of 32 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2025Qwen3 Technical Reportcited by 8,195
  7. 2023Segment Anythingcited by 8,158
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  10. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  11. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  12. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
15 more
  1. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  2. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  3. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  4. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  5. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  6. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  7. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
  8. 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
  9. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
  10. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  11. 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
  12. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  13. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 33
  14. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  15. 2023TongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shotcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
  2. 2025SyncAnyone: Implicit Disentanglement via Progressive Self-Correction for Lip-Syncing in the wild
  3. 2026AudioFace: Language-Assisted Speech-Driven Facial Animation with Multimodal Language Models
  4. 2024High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model
  5. 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment
  6. 2026MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation
  7. 2025IMTalker: Efficient Audio-driven Talking Face Generation with Implicit Motion Transfer
  8. 2025Navigating Large-Pose Challenge for High-Fidelity Face Reenactment with Video Diffusion Model