X2C: A Large-Scale Benchmark for Nuanced Humanoid Facial Expression Imitation
Not on the map. Why?
Abstract (arXiv)
Fine-grained facial expression transfer from humans to humanoid agents presents a unique pattern recognition challenge due to the significant domain gap between biological facial dynamics and mechanical control spaces. While visual synthesis of talking heads has advanced rapidly, mapping high-dimensional visual cues to precise, physically constrained actuation signals remains an open problem, primarily due to the lack of large-scale paired data. To bridge this gap, we introduce X2C, a comprehensive benchmark dataset comprising 100,000 (image, control value) pairs. Unlike existing resources, X2C features nuanced, physically grounded expressions annotated with 30 continuous control parameters, establishing a high-fidelity standard for this task. Building on this resource, we propose X2CNet, a two-stage deep learning framework that explicitly decouples visual motion features from mechanical control regression to model the correspondence between human perceptual cues and humanoid actuation. Extensive experiments, including quantitative benchmarking and real-world physical validation, demonstrate that our approach achieves superior cross-domain consistency and enables robust, in-the-wild expression imitation. Code and Data: https://lipzh5.github.io/X2CNet/
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 104 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
41 of 104 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2016Generative Adversarial Imitation Learningcited by 1,597
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2015End-to-End Training of Deep Visuomotor Policiescited by 875
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
- 2020First Order Motion Model for Image Animationcited by 704
29 more
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2018Everybody Dance Nowcited by 315
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
- 2021Motion Representations for Articulated Animationcited by 255
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2018Animating Arbitrary Objects via Deep Motion Transfercited by 208
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 185
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2024Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Paintingcited by 36
- 2021Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Modelscited by 12
- 2024Norface: Improving Facial Expression Analysis by Identity Normalizationcited by 10
- 2024Humanoid Robots and Humanoid AI: Review, Perspectives and Directionscited by 9
- 2024UGotMe: An Embodied System for Affective Human-Robot Interactioncited by 6
- 2021Facial emotion expressions in human-robot interaction: A surveycited by 5
- 2021A Conformal Mapping-based Framework for Robot-to-Robot and Sim-to-Real Transfer Learningcited by 2
- 2025Xpress: A System For Dynamic, Context-Aware Robot Facial Expressions using Language Modelscited by 1
- 2025FABG : End-to-end Imitation Learning for Embodied Affective Human-Robot Interactioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.