SuperFace: Preference-Aligned Facial Expression Estimation Beyond Pseudo Supervision
Not on the map. Why?
Abstract (arXiv)
Accurate facial estimation is crucial for realistic digital human animation, and ARKit blendshape coefficients offer an interpretable representation by mapping facial motions to semantic animation controls. However, learning high-quality ARKit coefficient prediction remains limited by the absence of reliable ground-truth supervision. Existing methods typically rely on capture software such as Live Link Face to provide pseudo labels, which may contain noisy activations, biased coefficient magnitudes, and missing or inaccurate facial actions. Consequently, models trained with supervised learning tend to reproduce imperfect pseudo labels rather than optimize for perceptual expression fidelity. In this paper, we propose SuperFace, a preference-driven framework that moves ARKit facial expression estimation from pseudo-label imitation toward human-aligned perceptual optimization. Instead of treating software-estimated coefficients as fixed ground truth, SuperFace uses them only as an initialization and further improves coefficient prediction through human preference feedback on rendered facial expressions. By aligning the model with perceptual judgments rather than numerical pseudo labels, SuperFace enables more visually faithful and expressive facial animation. Experiments show that SuperFace improves expression fidelity over Live Link Face supervision, demonstrating the effectiveness of preference-driven optimization for semantic facial action prediction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
24 of 40 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
12 more
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2018A Compact Embedding for Facial Expression Similaritycited by 41
- 2018ExpNet: Landmark-Free, Deep, 3D Facial Expressionscited by 29
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2025FaceLLM: A Multimodal Large Language Model for Face Understandingcited by 15
- 2024Ig3D: Integrating 3D Face Representations in Facial Expression Inferencecited by 6
- 2025FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoningcited by 5
- 2025Multimodal Prompt Alignment for Facial Expression Recognitioncited by 4
- 2025Express4D: Expressive, Friendly, and Extensible 4D Facial Motion Generation Benchmarkcited by 4
- 2026SemanticFace: Semantic Facial Action Estimation via Semantic Distillation in Interpretable Spacecited by 2
- 2023Blendshapes GHUM: Real-time Monocular Facial Blendshape Predictioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HAPI: A Model for Learning Robot Facial Expressions from Human Preferences
- 2025MagicFace: High-Fidelity Facial Expression Editing with Action-Unit Control
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint
- 2026FMReward: Aligning and Evaluating Audio-Driven 3D Facial Animation with Human Preferences
- 2026Facial Expression Generation Aligned with Human Preference for Natural Dyadic Interaction
- 2024Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance
- 2025EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models
- 2025ID-Consistent, Precise Expression Generation with Blendshape-Guided Diffusion