LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication
Not on the map. Why?
Abstract (arXiv)
Real-time stereoscopic video communication has long been a goal of immersive telepresence, yet practical systems still require specialized capture rigs or reduce remote users to a single portrait view. We present LentiAvatar, a Gaussian head-avatar system that connects monocular avatar capture with subpixel-encoded glasses-free lenticular display for real-time autostereoscopic communication. From a monocular portrait video, LentiAvatar reconstructs a controllable head avatar and optimizes it for the lateral viewing zones induced by the display. The method uses natural head turns as pseudo-multiview (PMV) supervision to constrain regions that are otherwise weakly observed in monocular training, including hair, ears, jaw contours, and neck boundaries. Reliable side frames are yaw-binned, aligned to virtual cameras, and supervised within a strict head-and-hair domain; contour-aware losses and staged regularization further suppress ghosting, alpha leakage, and depth instability while preserving lateral detail. At runtime, LentiAvatar renders 32 virtual views and encodes them into a 4K lenticular raster with calibrated subpixel-routing masks. The live-tracker prototype sustains 10.65 FPS, and a subject-specific distilled driver raises the same display pipeline to 38.49 FPS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 62 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
22 of 62 references.
References · 22
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2018Deep Video Portraitscited by 267
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2021Pixel Codec Avatarscited by 127
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
10 more
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2025HRAvatar: High-Quality and Relightable Gaussian Head Avatarcited by 25
- 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
- 2023BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesiscited by 20
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
- 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
- 2024DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displayscited by 1
Built on by
Not cited yet.