mlsanityData to 7 Oct 2026

Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environment

arXiv 2301.06648 ↗First posted 17 Jan 2023cs.CV cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

As a beloved sport worldwide, dancing is getting integrated into traditional and virtual reality-based gaming platforms nowadays. It opens up new opportunities in the technology-mediated dancing space. These platforms primarily rely on passive and continuous human pose estimation as an input capture mechanism. Existing solutions are mainly based on RGB or RGB-Depth cameras for dance games. The former suffers in low-lighting conditions due to the motion blur and low sensitivity, while the latter is too power-hungry, has a low frame rate, and has limited working distance. With ultra-low latency, energy efficiency, and wide dynamic range characteristics, the event camera is a promising solution to overcome these shortcomings. We propose YeLan, an event camera-based 3-dimensional high-frequency human pose estimation(HPE) system that survives low-lighting conditions and dynamic backgrounds. We collected the world's first event camera dance dataset and developed a fully customizable motion-to-event physics-aware simulator. YeLan outperforms the baseline models in these challenging conditions and demonstrated robustness against different types of clothing, background motion, viewing angle, occlusion, and lighting fluctuations.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 32 of its 93 references that are in the map. First posted on arXiv 17 Jan 2023.

Builds on

32 of 93 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  6. 2019Event-based Vision: A Surveycited by 1,010
  7. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  8. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
  9. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  10. 2016The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAMcited by 203
  11. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 197
  12. 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
20 more
  1. 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
  2. 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
  3. 2018EV-SegNet: Semantic Segmentation for Event-based Camerascited by 92
  4. 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 91
  5. 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
  6. 2020Learning Monocular Dense Depth from Eventscited by 84
  7. 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
  8. 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
  9. 2018Learning Monocular 3D Human Pose Estimation from Multi-view Imagescited by 70
  10. 2020Monocular Human Pose Estimation: A Survey of Deep Learning-based Methodscited by 59
  11. 2018MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimationcited by 49
  12. 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
  13. 20183D Human Pose Estimation in RGBD Images for Robotic Task Learningcited by 33
  14. 2016Robust 3D Hand Pose Estimation in Single Depth Images: from Single-View CNN to Multi-View CNNscited by 29
  15. 2021Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Camerascited by 27
  16. 2021Comparing Representations in Tracking for Event Camera-based SLAMcited by 23
  17. 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
  18. 2021Lifting Monocular Events to 3D Human Posescited by 16
  19. 2019Spatiotemporal Filtering for Event-Based Action Recognitioncited by 13
  20. 2020Dynamic Resource-aware Corner Detection for Bio-inspired Vision Sensorscited by 4

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2; 2025: 3.

8 papers.

  1. 2023V2CE: Video to Continuous Events Simulatorcited by 24
  2. 2024Microsaccade-inspired Event Camera for Roboticscited by 17
  3. 2025Event Quality Score (EQS): Assessing the Realism of Simulated Event Camera Streams via Distances in Latent Spacecited by 7
  4. 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimizationcited by 3
  5. 2025Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Reviewcited by 3
  6. 2023Efficient, Self-Supervised Human Pose Estimation with Inductive Prior Tuningcited by 1
  7. 2023Spike-based Neuromorphic Computing for Next-Generation Computer Visioncited by 0
  8. 2025When Dance Video Archives Challenge Computer Visioncited by 0