mlsanityData to 14 Oct 2026

Bringing Telepresence to Every Desk

arXiv 2304.01197 ↗First posted 3 Apr 2023cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we work to bring telepresence to every desktop. Unlike commercial systems, personal 3D video conferencing systems must render high-quality videos while remaining financially and computationally viable for the average consumer. To this end, we introduce a capturing and rendering system that only requires 4 consumer-grade RGBD cameras and synthesizes high-quality free-viewpoint videos of users as well as their environments. Experimental results show that our system renders high-quality free-viewpoint videos without using object templates or heavy pre-processing. While not real-time, our system is fast and does not require per-video optimizations. Moreover, our system is robust to complex hand gestures and clothing, and it can generalize to new users. This work provides a strong basis for further optimization, and it will help bring telepresence to every desk in the near future. The code and dataset will be made available on our website https://mcmvmc.github.io/PersonalTelepresence/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 69 references that are in the map. First posted on arXiv 3 Apr 2023.

Builds on

35 of 69 references.

References · 35

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  6. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  7. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  8. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  9. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  10. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  11. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  12. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
23 more
  1. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  3. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  4. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  7. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  8. 2019Neural Point-Based Graphicscited by 327
  9. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  10. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  11. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  12. 2020Free View Synthesiscited by 231
  13. 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
  14. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  15. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  16. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 190
  17. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  18. 2020Stable View Synthesiscited by 165
  19. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  20. 2019Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awarenesscited by 151
  21. 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
  22. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  23. 2021VirtualCube: An Immersive 3D Video Communication Systemcited by 11

Built on by

Not cited yet.