KaoLRM: Repurposing Pre-trained Large Reconstruction Models for Parametric 3D Face Reconstruction
Not on the map. Why?
Abstract (arXiv)
We propose KaoLRM to re-target the learned prior of the Large Reconstruction Model (LRM) for parametric 3D face reconstruction from single-view images. Parametric 3D Morphable Models (3DMMs) have been widely used for facial reconstruction due to their compact and interpretable parameterization, yet existing 3DMM regressors often exhibit poor consistency across varying viewpoints. To address this, we harness the pre-trained 3D prior of LRM and incorporate FLAME-based 2D Gaussian Splatting into LRM's rendering pipeline. Specifically, KaoLRM projects LRM's pre-trained triplane features into the FLAME parameter space to recover geometry, and models appearance via 2D Gaussian primitives that are tightly coupled to the FLAME mesh. The rich prior enables the FLAME regressor to be aware of the 3D structure, leading to accurate and robust reconstructions under self-occlusions and diverse viewpoints. Experiments on both controlled and in-the-wild benchmarks demonstrate that KaoLRM achieves superior reconstruction accuracy and cross-view consistency, while existing methods remain sensitive to viewpoint variations. The code is released at https://github.com/CyberAgentAILab/KaoLRM.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 64 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
41 of 64 references.
References · 41
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
29 more
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 222
- 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2017Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hzcited by 91
- 2022Multiface: A Dataset for Neural Face Renderingcited by 87
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2018FML: Face Model Learning from Videoscited by 78
- 2022Learning Neural Parametric Head Modelscited by 73
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
- 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
- 2022SunStage: Portrait Reconstruction and Relighting using the Sun as a Light Stagecited by 30
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2025SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussianscited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.