mlsanityData to 14 Oct 2026

3D Human Scan With A Moving Event Camera

arXiv 2404.08504 ↗First posted 12 Apr 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Capturing a 3D human body is one of the important tasks in computer vision with a wide range of applications such as virtual reality and sports analysis. However, conventional frame cameras are limited by their temporal resolution and dynamic range, which imposes constraints in real-world application setups. Event cameras have the advantages of high temporal resolution and high dynamic range (HDR), but the development of event-based methods is necessary to handle data with different characteristics. This paper proposes a novel event-based method for 3D pose estimation and human mesh recovery. Prior work on event-based human mesh recovery require frames (images) as well as event data. The proposed method solely relies on events; it carves 3D voxels by moving the event camera around a stationary body, reconstructs the human pose and mesh by attenuated rays, and fit statistical body models, preserving high-frequency details. The experimental results show that the proposed method outperforms conventional frame-based methods in the estimation accuracy of both pose and body mesh. We also demonstrate results in challenging situations where a conventional camera has motion blur. This is the first to demonstrate event-only human mesh recovery, and we hope that it is the first step toward achieving robust and accurate 3D human body scanning from vision sensors. https://florpeng.github.io/event-based-human-scan/

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 32 of its 55 references that are in the map. First posted on arXiv 12 Apr 2024.

Builds on

32 of 55 references.

References · 32

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  3. 2019Event-based Vision: A Surveycited by 1,016
  4. 2017End-to-end Recovery of Human Shape and Posecited by 885
  5. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  6. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  7. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  8. 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
  9. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
  10. 2018Event-based Moving Object Detection and Trackingcited by 127
  11. 2017Compositional Human Pose Regressioncited by 124
  12. 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 113
20 more
  1. 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
  2. 2019Generating Multiple Hypotheses for 3D Human Pose Estimation with Mixture Density Networkcited by 92
  3. 2022Secrets of Event-Based Optical Flowcited by 92
  4. 2019Fast and Robust Multi-Person 3D Pose Estimation from Multiple Viewscited by 83
  5. 2019EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Cameracited by 65
  6. 2020Event Based, Near Eye Gaze Tracking Beyond 10,000Hzcited by 53
  7. 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
  8. 2015Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose Estimationcited by 37
  9. 2024CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximizationcited by 31
  10. 20163D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Informationcited by 28
  11. 2022Efficient Human Pose Estimation via 3D Event Point Cloudcited by 25
  12. 2021ESL: Event-based Structured Lightcited by 22
  13. 20193D Human Pose Machines with Self-supervised Learningcited by 17
  14. 2021Lifting Monocular Events to 3D Human Posescited by 16
  15. 2022A Fast Geometric Regularizer to Mitigate Event Collapse in the Contrast Maximization Frameworkcited by 16
  16. 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstructioncited by 14
  17. 2018Deep Autoencoder for Combined Human Pose Estimation and body Model Upscalingcited by 12
  18. 2022Fast Event-based Optical Flow Estimation by Triplet Matchingcited by 11
  19. 2023EvAC3D: From Event-based Apparent Contours to 3D Models via Continuous Visual Hullscited by 11
  20. 2023Event-based Background-Oriented Schlierencited by 11

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

  1. 2025Event-based Solutions for Human-centered Applications: A Comprehensive Reviewcited by 2
  2. 2025E-CHUM: Event-based Cameras for Human Detection and Urban Monitoringcited by 1