EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera
Not on the map. Why?
Abstract (arXiv)
The high frame rate is a critical requirement for capturing fast human motions. In this setting, existing markerless image-based methods are constrained by the lighting requirement, the high data bandwidth and the consequent high computation overhead. In this paper, we propose EventCap --- the first approach for 3D capturing of high-speed human motions using a single event camera. Our method combines model-based optimization and CNN-based human pose detection to capture high-frequency motion details and to reduce the drifting in the tracking. As a result, we can capture fast motions at millisecond resolution with significantly higher data efficiency than using high frame rate videos. Experiments on our new event-based fast human motion dataset demonstrate the effectiveness and accuracy of our method, as well as its robustness to challenging lighting conditions.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 10; 2024: 17; 2025: 8; 2026: 6.
65 papers.
Sort:
By area:
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 46
- 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensorscited by 43
- 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
- 2021NeuralHumanFVV: Real-Time Neural Volumetric Human Performance Rendering using RGB Camerascited by 40
- 2022LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Cloudscited by 32
- 2021Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translationcited by 31
38 more
- 2021Gravity-Aware Monocular 3D Human-Object Reconstructioncited by 30
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streamscited by 29
- 2024Line-based 6-DoF Object Pose Estimation and Tracking With an Event Cameracited by 29
- 2023CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactionscited by 27
- 2021ChallenCap: Monocular 3D Capture of Challenging Human Performances using Multi-Modal Referencescited by 26
- 2021RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Streamcited by 26
- 2022Efficient Human Pose Estimation via 3D Event Point Cloudcited by 25
- 2021Differentiable Event Stream Simulator for Non-Rigid 3D Trackingcited by 23
- 2024LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environmentcited by 20
- 2022HybridCap: Inertia-aid Monocular Capture of Challenging Human Motionscited by 19
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
- 2023EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervisioncited by 17
- 20233D Pose Estimation of Two Interacting Hands from a Monocular Event Cameracited by 17
- 2024Microsaccade-inspired Event Camera for Roboticscited by 17
- 2021Lifting Monocular Events to 3D Human Posescited by 16
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Methodcited by 16
- 2022MonoNHR: Monocular Neural Human Renderercited by 15
- 2024Deblurring Neural Radiance Fields with Event-driven Bundle Adjustmentcited by 15
- 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstructioncited by 14
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2023A Hybrid ANN-SNN Architecture for Low-Power and Low-Latency Visual Perceptioncited by 13
- 2022HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performancescited by 12
- 2023Highly Efficient 3D Human Pose Tracking from Events with Spiking Spatiotemporal Transformercited by 10
- 2024E3NeRF: Efficient Event-Enhanced Neural Radiance Fields from Blurry Imagescited by 8
- 2024SpikeNeRF: Learning Neural Radiance Fields from Continuous Spike Streamcited by 7
- 2024LiveHPS++: Robust and Coherent Motion Capture in Dynamic Free Environmentcited by 6
- 2025EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Cameracited by 6
- 2022A Temporal Densely Connected Recurrent Network for Event-based Human Pose Estimationcited by 5
- 2023Exploring Event-based Human Pose Estimation with 3D Event Representationscited by 4
- 2024Bilateral Event Mining and Complementary for Event Stream Super-Resolutioncited by 3
- 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimizationcited by 3
- 2024Dynamic EventNeRF: Reconstructing General Dynamic Scenes from Multi-view RGB and Event Streamscited by 3
- 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Camerascited by 3
- 2021Render In-between: Motion Guided Video Synthesis for Action Interpolationcited by 2
- 2022Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimationcited by 2
- 20243D Human Scan With A Moving Event Cameracited by 2
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Reviewcited by 2
50 most cited of 65 All 65 (JSON)
- 2026Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration3 Aug 2026
- 2026EveLoad: Cognitive Workload Recognition from Event-Based Eye Movements23 Jun 2026
- 2026E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimation9 Apr 2026
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2026FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision20 Mar 2026
- 2026EventNeuS: 3D Mesh Reconstruction from a Single Event Camera3 Feb 2026
- 2025E-CHUM: Event-based Cameras for Human Detection and Urban Monitoring11 Dec 2025
- 2025Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation6 Dec 2025
- 2025GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network9 Oct 2025
- 2025VibES: Induced Vibration for Persistent Event-Based Sensing26 Aug 2025
- 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras30 Jul 2025
- 2025Multi-Timescale Motion-Decoupled Spiking Transformer for Audio-Visual Zero-Shot Learning26 May 2025
38 more
- 2025Event-based Solutions for Human-centered Applications: A Comprehensive Review17 Feb 2025
- 2025EventEgo3D++: 3D Human Motion Capture from a Head-Mounted Event Camera11 Feb 2025
- 2024Dynamic EventNeRF: Reconstructing General Dynamic Scenes from Multi-view RGB and Event Streams9 Dec 2024
- 2024ExFMan: Rendering 3D Dynamic Humans with Hybrid Monocular Blurry Frames and Events21 Sep 2024
- 2024Recent Event Camera Innovations: A Survey24 Aug 2024
- 2024Line-based 6-DoF Object Pose Estimation and Tracking With an Event Camera6 Aug 2024
- 2024E3NeRF: Efficient Event-Enhanced Neural Radiance Fields from Blurry Images3 Aug 2024
- 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimization2 Aug 2024
- 2024LiveHPS++: Robust and Coherent Motion Capture in Dynamic Free Environment13 Jul 2024
- 2024Deblurring Neural Radiance Fields with Event-driven Bundle Adjustment20 Jun 2024
- 2024Microsaccade-inspired Event Camera for Robotics28 May 2024
- 2024Bilateral Event Mining and Complementary for Event Stream Super-Resolution16 May 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2024EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams12 Apr 2024
- 20243D Human Scan With A Moving Event Camera12 Apr 2024
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method28 Mar 2024
- 2024SpikeNeRF: Learning Neural Radiance Fields from Continuous Spike Stream17 Mar 2024
- 2024Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction12 Mar 2024
- 2024LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment27 Feb 2024
- 2023EvPlug: Learn a Plug-and-Play Module for Event and Image Fusion28 Dec 2023
- 20233D Pose Estimation of Two Interacting Hands from a Monocular Event Camera21 Dec 2023
- 2023Exploring Event-based Human Pose Estimation with 3D Event Representations8 Nov 2023
- 2023UltraGlove: Hand Pose Estimation with Mems-Ultrasonic Sensors22 Jun 2023
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions12 Apr 2023
- 2023CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions31 Mar 2023
- 2023A Hybrid ANN-SNN Architecture for Low-Power and Low-Latency Visual Perception24 Mar 2023
- 2023Highly Efficient 3D Human Pose Tracking from Events with Spiking Spatiotemporal Transformer16 Mar 2023
- 2023EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervision6 Mar 2023
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks17 Feb 2023
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstruction27 Oct 2022
- 2022HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performances11 Oct 2022
- 2022MonoNHR: Monocular Neural Human Renderer2 Oct 2022
- 2022A Temporal Densely Connected Recurrent Network for Event-based Human Pose Estimation15 Sep 2022
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes17 Aug 2022
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Camera23 Jun 2022
- 2022Efficient Human Pose Estimation via 3D Event Point Cloud9 Jun 2022
- 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors30 May 2022
- 2022LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Clouds28 Mar 2022
50 newest of 65 All 65 (JSON)
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 46
- 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensorscited by 43
- 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
- 2021NeuralHumanFVV: Real-Time Neural Volumetric Human Performance Rendering using RGB Camerascited by 40
- 2022LiDARCap: Long-range Marker-less 3D Human Motion Capture with LiDAR Point Cloudscited by 32
- 2021Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translationcited by 31
- 2021Gravity-Aware Monocular 3D Human-Object Reconstructioncited by 30
12 most cited of 63 All 63 (JSON)
- 2026Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration3 Aug 2026
- 2026EveLoad: Cognitive Workload Recognition from Event-Based Eye Movements23 Jun 2026
- 2026E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimation9 Apr 2026
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2026FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision20 Mar 2026
- 2026EventNeuS: 3D Mesh Reconstruction from a Single Event Camera3 Feb 2026
- 2025E-CHUM: Event-based Cameras for Human Detection and Urban Monitoring11 Dec 2025
- 2025Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation6 Dec 2025
- 2025GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network9 Oct 2025
- 2025VibES: Induced Vibration for Persistent Event-Based Sensing26 Aug 2025
- 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras30 Jul 2025
- 2025Multi-Timescale Motion-Decoupled Spiking Transformer for Audio-Visual Zero-Shot Learning26 May 2025
12 newest of 63 All 63 (JSON)