Real-Time Human Frontal View Synthesis from a Single Image
Not on the map. Why?
Abstract (arXiv)
Photorealistic human novel view synthesis from a single image is crucial for democratizing immersive 3D telepresence, eliminating the need for complex multi-camera setups. However, current rendering-centric methods prioritize visual fidelity over explicit geometric understanding and struggle with intricate regions like faces and hands, leading to temporal instability. Meanwhile, human-centric frameworks suffer from memory bottlenecks since they typically rely on an auxiliary model to provide informative structural priors for geometric modeling, which limits real-time performance. To address these challenges, we propose PrismMirror, a geometry-guided framework for instant frontal view synthesis from a single image. By avoiding external geometric modeling and focusing on frontal view synthesis, our model optimizes visual integrity for telepresence. Specifically, PrismMirror introduces a novel cascade learning strategy that enables coarse-to-fine geometric feature learning. It first directly learns coarse geometric features, such as SMPL-X meshes and point clouds, and then refines textures through rendering supervision. To achieve real-time efficiency, we distill this unified framework into a lightweight linear attention model. Notably, PrismMirror is the first monocular human frontal view synthesis model that achieves real-time inference at 24 FPS, significantly outperforming previous methods in both visual authenticity and structural accuracy.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 64 of its 72 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
64 of 72 references.
References · 64
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2023HUGS: Human Gaussian Splatscited by 154
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
- 2020DeepCloth: Neural Garment Representation for Shape and Style Editingcited by 54
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
- 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
- 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.