mlsanityData to 14 Oct 2026

OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies

arXiv 2606.08043 ↗First posted 6 Jun 2026cs.GR cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Facial rigging - creating FACS-based blendshapes together with inner-mouth geometry (teeth, gums, and tongue) - remains a major bottleneck in 3D character production. Existing pipelines still require substantial designer effort, especially for manual landmark annotation, per-character template adjustment, and inner-mouth placement. We present OmniFaceRig, a fully automatic end-to-end pipeline that converts a static surface-only 3D character mesh, with no pre-modeled oral cavity, into an inner-mouth-aware FACS rig with up to 155 blendshapes, procedurally fitted teeth, gums, and tongue, and re-packed UV/texture. OmniFaceRig supports diverse topologies - humans, humanoids, long-muzzled animals (e.g., dogs, wolves, foxes), and short-muzzled animals (e.g., cats, bears, rabbits, tigers) - with no manual landmarks, no user-provided templates, and no per-asset setup. The pipeline combines hybrid VLM+CV riggability checking, multi-model face parsing, dense keypoint-driven template registration, procedural inner-mouth construction, and collision-aware blendshape transfer. For non-human characters, OmniFaceRig selects topology-specific face and inner-mouth templates and uses collision-aware inner-mouth fitting to reduce teeth-face intersections without exposing users to category-specific tuning. We also publicly release Omni-Bench, a freely available benchmark dataset of 1,000 biped 3D characters with FACS facial blendshapes and inner-mouth geometry, spanning humans, humanoids, cats, dogs, and other animals. Experiments show high final rigging success on screened Omni-Bench inputs, nearly complete face detection recall from the segmentation ensemble and reliable inner-mouth placement with low penetration. Together, OmniFaceRig provides an automatic path from static generated characters to animation-ready facial rigs across both human and non-human topologies.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 80 references that are in the map. First posted on arXiv 6 Jun 2026.

Builds on

47 of 80 references.

References · 47

  1. 2023Segment Anythingcited by 8,234
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  8. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  9. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  10. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  11. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
  12. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
35 more
  1. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  2. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  3. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  4. 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
  5. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
  6. 2020Learning Formation of Physically-Based Face Attributescited by 94
  7. 2022Multiface: A Dataset for Neural Face Renderingcited by 87
  8. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 80
  9. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  10. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  11. 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
  12. 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
  13. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  14. 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
  15. 2019Disentangled Representation Learning for 3D Face Shapecited by 48
  16. 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 38
  17. 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
  18. 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
  19. 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
  20. 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
  21. 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 28
  22. 2025Anymate: A Dataset and Baselines for Learning 3D Object Riggingcited by 27
  23. 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
  24. 2020Dynamic Facial Asset and Rig Generation from a Single Scancited by 21
  25. 2024Gaussian Eigen Models for Human Headscited by 21
  26. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
  27. 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
  28. 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characterscited by 13
  29. 2023Make-A-Character: High Quality Text-to-3D Character Generation within Minutescited by 8
  30. 2024Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Textcited by 7
  31. 2024High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Renderingcited by 6
  32. 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloningcited by 5
  33. 2024Compressed Skinning for Facial Blendshapescited by 4
  34. 2024ControlFace: Harnessing Facial Parametric Control for Face Riggingcited by 4
  35. 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Datacited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.