mlsanityData to 7 Oct 2026

Point2Pose: A Generative Framework for 3D Human Pose Estimation with Multi-View Point Cloud Dataset

arXiv 2512.10321 ↗First posted 11 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose a novel generative approach for 3D human pose estimation. 3D human pose estimation poses several key challenges due to the complex geometry of the human body, self-occluding joints, and the requirement for large-scale real-world motion datasets. To address these challenges, we introduce Point2Pose, a framework that effectively models the distribution of human poses conditioned on sequential point cloud and pose history. Specifically, we employ a spatio-temporal point cloud encoder and a pose feature encoder to extract joint-wise features, followed by an attention-based generative regressor. Additionally, we present a large-scale indoor dataset MVPose3D, which contains multiple modalities, including IMU data of non-trivial human motions, dense multi-view point clouds, and RGB images. Experimental results show that the proposed method outperforms the baseline models, demonstrating its superior performance across various datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

45 of 61 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  9. 2021ViViT: A Video Vision Transformercited by 1,610
  10. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  11. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  12. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
33 more
  1. 2021Multiscale Vision Transformerscited by 896
  2. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  3. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  4. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  5. 2017Learning from Synthetic Humanscited by 358
  6. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  7. 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 99
  8. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  9. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  10. 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
  11. 2021Self-supervised Video Transformercited by 64
  12. 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
  13. 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
  14. 2022LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensorscited by 43
  15. 2021Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wildcited by 40
  16. 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
  17. 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
  18. 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
  19. 2023CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactionscited by 27
  20. 2024Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusioncited by 27
  21. 2021DECA: Deep viewpoint-Equivariant human pose estimation using Capsule Autoencoderscited by 23
  22. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
  23. 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
  24. 2024LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environmentcited by 20
  25. 2024HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloudcited by 12
  26. 2020Multi-view Human Pose and Shape Estimation Using Learnable Volumetric Aggregationcited by 10
  27. 2023PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Cloudscited by 9
  28. 2023Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Drivingcited by 8
  29. 2023MOVIN: Real-time Motion Capture using a Single LiDARcited by 6
  30. 2022ACRNet: Attention Cube Regression Network for Multi-view Real-time 3D Human Pose Estimation in Telemedicinecited by 2
  31. 2024SPiKE: 3D Human Pose from Point Cloud Sequencescited by 2
  32. 2024Depth-based Privileged Information for Boosting 3D Human Pose Estimation on RGBcited by 1
  33. 2024ELMO: Enhanced Real-time LiDAR Motion Capture through Upsamplingcited by 1

Built on by

Not cited yet.