FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices
Not on the map. Why?
Abstract (arXiv)
Prior avatar embodiment research has studied tracking completeness (how faithfully the body, hands, and face are sensed and reproduced) and personalized appearance in isolation, each requiring specialized lab equipment. How these factors interact on consumer hardware remains an open question, because no existing system unifies body pose, face, hands, and personalized appearance on a standalone headset. We present FlowAvatar, a system enabling real-time personalized look-alike avatars with full-body pose, hand articulation, facial expression, and eye gaze tracking from sparse egocentric inputs on consumer XR devices (Meta Quest Pro). Our pose model achieves competitive spatial accuracy and state-of-the-art temporal consistency on the AMASS benchmark against prior works with comprehensive spatial and temporal losses validated through architecture and loss ablations, while running in real-time. Two user studies (N=12, N=10) provide converging evidence that tracking completeness and personalized appearance serve complementary roles: tracking completeness broadly improves perceived motion quality, while only their combination achieves positive total embodiment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 71 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
32 of 71 references.
References · 32
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2018Video Based Reconstruction of 3D People Modelscited by 238
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 183
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
20 more
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2021Pixel Codec Avatarscited by 127
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
- 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
- 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 105
- 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 77
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 54
- 2023STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detectioncited by 43
- 2023Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modelingcited by 43
- 2023EgoPoser: Robust Real-Time Egocentric Pose Estimation from Sparse and Intermittent Observations Everywherecited by 34
- 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 31
- 2024HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Priorcited by 31
- 2020TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Videocited by 28
- 2024HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observationscited by 25
- 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 23
- 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observationscited by 18
- 2022Robust Human Matting via Semantic Guidancecited by 12
- 2024SqueezeMe: Mobile-Ready Distillation of Gaussian Full-Body Avatarscited by 11
- 2024EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatarscited by 8
Built on by
Not cited yet.