OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies
Not on the map. Why?
Abstract (arXiv)
Facial rigging - creating FACS-based blendshapes together with inner-mouth geometry (teeth, gums, and tongue) - remains a major bottleneck in 3D character production. Existing pipelines still require substantial designer effort, especially for manual landmark annotation, per-character template adjustment, and inner-mouth placement. We present OmniFaceRig, a fully automatic end-to-end pipeline that converts a static surface-only 3D character mesh, with no pre-modeled oral cavity, into an inner-mouth-aware FACS rig with up to 155 blendshapes, procedurally fitted teeth, gums, and tongue, and re-packed UV/texture. OmniFaceRig supports diverse topologies - humans, humanoids, long-muzzled animals (e.g., dogs, wolves, foxes), and short-muzzled animals (e.g., cats, bears, rabbits, tigers) - with no manual landmarks, no user-provided templates, and no per-asset setup. The pipeline combines hybrid VLM+CV riggability checking, multi-model face parsing, dense keypoint-driven template registration, procedural inner-mouth construction, and collision-aware blendshape transfer. For non-human characters, OmniFaceRig selects topology-specific face and inner-mouth templates and uses collision-aware inner-mouth fitting to reduce teeth-face intersections without exposing users to category-specific tuning. We also publicly release Omni-Bench, a freely available benchmark dataset of 1,000 biped 3D characters with FACS facial blendshapes and inner-mouth geometry, spanning humans, humanoids, cats, dogs, and other animals. Experiments show high final rigging success on screened Omni-Bench inputs, nearly complete face detection recall from the segmentation ensemble and reliable inner-mouth placement with low penetration. Together, OmniFaceRig provides an automatic path from static generated characters to animation-ready facial rigs across both human and non-human topologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 80 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
47 of 80 references.
References · 47
- 2023Segment Anythingcited by 8,234
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
35 more
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2020Learning Formation of Physically-Based Face Attributescited by 94
- 2022Multiface: A Dataset for Neural Face Renderingcited by 87
- 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 80
- 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2019Disentangled Representation Learning for 3D Face Shapecited by 48
- 2024MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editingcited by 38
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
- 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 28
- 2025Anymate: A Dataset and Baselines for Learning 3D Object Riggingcited by 27
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2020Dynamic Facial Asset and Rig Generation from a Single Scancited by 21
- 2024Gaussian Eigen Models for Human Headscited by 21
- 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
- 2023Zero-shot Pose Transfer for Unrigged Stylized 3D Characterscited by 13
- 2023Make-A-Character: High Quality Text-to-3D Character Generation within Minutescited by 8
- 2024Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Textcited by 7
- 2024High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Renderingcited by 6
- 2025Neural Face Skinning for Mesh-agnostic Facial Expression Cloningcited by 5
- 2024Compressed Skinning for Facial Blendshapescited by 4
- 2024ControlFace: Harnessing Facial Parametric Control for Face Riggingcited by 4
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Datacited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.