GRAPE: Graduated Routing for Articulated Portrait mesh Estimation
Not on the map. Why?
Abstract (arXiv)
Articulated portrait mesh estimation is fundamental to 3D understanding, avatar generation, and immersive interaction. Existing approaches primarily rely on 3D Morphable Models (3DMMs). However, face-centric models suffer from the "floating head" assumption, conflating head pose with global rotation due to the lack of neck kinematics. Conversely, body-centric models lack high-fidelity facial expression capabilities. Furthermore, current methods struggle to disentangle jaw articulation from expression blendshapes, often over-relying on expressions for mouth opening. These limitations make monocular portrait recovery difficult across representation, supervision, and anatomical parameter estimation. To address these limitations, we introduce GRAPE(Graduated Routing for Articulated Portrait mesh Estimation). We build a Portrait Parametric Model (PPM) with an explicit torso-to-head kinematic chain and a canonical injection step to merge FLAME and the SMPL-X torso. We propose a Progressive Anatomical Alignment (PAA) network, which is composed of a pretrained portrait encoder, a Graduated-Mask Router, and coarse-to-fine experts that follow the portrait anatomical prior. We then train this network with multi-source supervision that combines sparse anatomical keypoints, feature distillation, foreground mask constraints, and relative geometry constraints. Experiments show that GRAPE improves portrait mesh recovery quality, pose alignment, and jaw--expression disentanglement over prior methods. We also demonstrate that our method can benefit the downstream tasks of audio-driven talking-head generation and 3D portrait generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
23 of 40 references.
References · 23
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2022Towards Metrical Reconstruction of Human Facescited by 166
11 more
- 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
- 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 32
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
- 2018Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wildcited by 22
- 2025TEASER: Token Enhanced Spatial Modeling for Expressions Reconstructioncited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FG-Portrait: 3D Flow Guided Editable Portrait Animation
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models
- 2025Disentangling 3D from Large Vision-Language Models for Controlled Portrait Generation
- 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction
- 2024Personalized 3D Human Pose and Shape Refinement
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
- 2025PHD: Personalized 3D Human Body Fitting with Point Diffusion