Body Meshes as Points
Not on the map. Why?
Abstract (arXiv)
We consider the challenging multi-person 3D body mesh estimation task in this work. Existing methods are mostly two-stage based--one stage for person localization and the other stage for individual body mesh estimation, leading to redundant pipelines with high computation cost and degraded performance for complex scenes (e.g., occluded person instances). In this work, we present a single-stage model, Body Meshes as Points (BMP), to simplify the pipeline and lift both efficiency and performance. In particular, BMP adopts a new method that represents multiple person instances as points in the spatial-depth space where each point is associated with one body mesh. Hinging on such representations, BMP can directly predict body meshes for multiple persons in a single stage by concurrently localizing person instance points and estimating the corresponding body meshes. To better reason about depth ordering of all the persons within the same scene, BMP designs a simple yet effective inter-instance ordinal depth loss to obtain depth-coherent body mesh estimation. BMP also introduces a novel keypoint-aware augmentation to enhance model robustness to occluded person instances. Comprehensive experiments on benchmarks Panoptic, MuPoTS-3D and 3DPW clearly demonstrate the state-of-the-art efficiency of BMP for multi-person body mesh estimation, together with outstanding accuracy. Code can be found at: https://github.com/jfzhang95/BMP.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Builds on 57 of its 76 references that are in the map. First posted on arXiv 6 May 2021.
Builds on
57 of 76 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2018Group Normalizationcited by 1,524
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2019Objects as Pointscited by 1,175
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
38 more
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2019SOLO: Segmenting Objects by Locationscited by 289
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2017Integral Human Pose Regressioncited by 256
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2020Coherent Reconstruction of Multiple Humans from a Single Imagecited by 136
- 2019Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Imagecited by 132
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
- 2019Exploiting temporal context for 3D human pose estimation in the wildcited by 110
- 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
- 2017Self-supervised Learning of Motion Capturecited by 97
- 2019Single-Stage Multi-Person Pose Machinescited by 95
- 2018LCR-Net++: Multi-person 2D and 3D Pose Detection in Natural Imagescited by 88
- 2017Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Imagecited by 73
- 2019Moulding Humans: Non-parametric 3D Human Shape Estimation from Single Imagescited by 67
- 2020Learning to Transfer Texture from Clothing Images to 3D Humanscited by 58
- 2020SMAP: Single-Shot Multi-Person Absolute 3D Pose Estimationcited by 52
- 2017Detect-and-Track: Efficient Pose Estimation in Videoscited by 51
- 2019Synthetic Humans for Action Recognition from Unseen Viewpointscited by 46
- 2020HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimationcited by 44
- 2020Compressed Volumetric Heatmaps for Multi-Person 3D Pose Estimationcited by 36
- 2019Multi-Person Pose Estimation with Enhanced Channel-wise and Spatial Informationcited by 35
- 2019FACSIMILE: Fast and Accurate Scans From an Image in Less Than a Secondcited by 35
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2021: 8; 2022: 10; 2023: 10; 2024: 11; 2025: 3; 2026: 3.
45 papers.
Sort:
By area:
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 20233D Human Pose Estimation via Intuitive Physicscited by 103
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2022Occluded Human Mesh Recoverycited by 54
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 53
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
33 more
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 34
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Viewscited by 33
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environmentscited by 29
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
- 2024Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaptioncited by 19
- 2023Reconstructing Groups of People with Hypergraph Relational Reasoningcited by 18
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2023Rendering Humans from Object-Occluded Monocular Videoscited by 14
- 2023Crowd3D: Towards Hundreds of People Reconstruction from a Single Imagecited by 12
- 2021Body Size and Depth Disambiguation in Multi-Person Reconstruction from Single Imagescited by 11
- 2022Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinementcited by 11
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimationcited by 9
- 2023IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiationcited by 9
- 2024STAF: 3D Human Mesh Recovery from Video with Spatio-Temporal Alignment Fusioncited by 9
- 2023Coordinate Transformer: Achieving Single-stage Multi-person Mesh Recovery from Videoscited by 5
- 2021View Birdification in the Crowd: Ground-Plane Localization from Perceived Movementscited by 4
- 20243D Reconstruction of Interacting Multi-Person in Clothing from a Single Imagecited by 4
- 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoningcited by 4
- 2022Permutation-Invariant Relational Network for Multi-person 3D Pose Estimationcited by 3
- 2022MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Posecited by 3
- 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Videocited by 3
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Spacecited by 3
- 2024Divide and Fuse: Body Part Mesh Recovery from Partially Visible Human Imagescited by 2
- 2024RCR: Robust Crowd Reconstruction with Upright Space from a Single Large-scene Imagecited by 2
- 2023InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Viewscited by 1
- 2026Masked Modeling for Human Motion Recovery Under Occlusionscited by 1
- 2024Multi-RoI Human Mesh Recovery with Camera Consistency and Contrastive Lossescited by 0
- 2024Human Shape and Clothing Estimationcited by 0
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignmentcited by 0
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recoverycited by 0
- 2026Contrastive Multi-Modal Hypergraph Reasoning for 3D Crowd Mesh Recoverycited by 0
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recovery6 May 2026
- 2026Contrastive Multi-Modal Hypergraph Reasoning for 3D Crowd Mesh Recovery1 Apr 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Space17 Nov 2025
- 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Video18 Aug 2025
- 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning3 Jul 2025
- 2024RCR: Robust Crowd Reconstruction with Upright Space from a Single Large-scene Image9 Nov 2024
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024Divide and Fuse: Body Part Mesh Recovery from Partially Visible Human Images12 Jul 2024
- 2024Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption17 Apr 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environment30 Mar 2024
33 more
- 2024Human Shape and Clothing Estimation28 Feb 2024
- 2024Multi-RoI Human Mesh Recovery with Camera Consistency and Contrastive Losses3 Feb 2024
- 2024RoHM: Robust Human Motion Reconstruction via Diffusion16 Jan 2024
- 20243D Reconstruction of Interacting Multi-Person in Clothing from a Single Image12 Jan 2024
- 2024STAF: 3D Human Mesh Recovery from Video with Spatio-Temporal Alignment Fusion3 Jan 2024
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videos20 Oct 2023
- 2023Reconstructing Groups of People with Hypergraph Relational Reasoning30 Aug 2023
- 2023Coordinate Transformer: Achieving Single-stage Multi-person Mesh Recovery from Videos20 Aug 2023
- 2023Rendering Humans from Object-Occluded Monocular Videos8 Aug 2023
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views12 Apr 2023
- 20233D Human Pose Estimation via Intuitive Physics31 Mar 2023
- 2023InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Views16 Mar 2023
- 2023Decoupling Human and Camera Motion from Videos in the Wild24 Feb 2023
- 2023IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiation2 Feb 2023
- 2023Crowd3D: Towards Hundreds of People Reconstruction from a Single Image23 Jan 2023
- 2022Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement24 Oct 2022
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms21 Sep 2022
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimation1 Aug 2022
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Images13 Jul 2022
- 2022MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose25 May 2022
- 2022Permutation-Invariant Relational Network for Multi-person 3D Pose Estimation11 Apr 2022
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision29 Mar 2022
- 2022Occluded Human Mesh Recovery24 Mar 2022
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation15 Mar 2022
- 2022Recovering 3D Human Mesh from Monocular Images: A Survey3 Mar 2022
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environments23 Dec 2021
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generation22 Dec 2021
- 2021Putting People in their Place: Monocular Regression of 3D People in Depth15 Dec 2021
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices14 Dec 2021
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras2 Dec 2021
- 2021View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements9 Nov 2021
- 2021Direct Multi-view Multi-person 3D Pose Estimation7 Nov 2021
- 2021Body Size and Depth Disambiguation in Multi-Person Reconstruction from Single Images2 Nov 2021
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 20233D Human Pose Estimation via Intuitive Physicscited by 103
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2022Occluded Human Mesh Recoverycited by 54
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 53
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
12 most cited of 42 All 42 (JSON)
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recovery6 May 2026
- 2026Contrastive Multi-Modal Hypergraph Reasoning for 3D Crowd Mesh Recovery1 Apr 2026
- 2026Masked Modeling for Human Motion Recovery Under Occlusions22 Jan 2026
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Space17 Nov 2025
- 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Video18 Aug 2025
- 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning3 Jul 2025
- 2024RCR: Robust Crowd Reconstruction with Upright Space from a Single Large-scene Image9 Nov 2024
- 2024Divide and Fuse: Body Part Mesh Recovery from Partially Visible Human Images12 Jul 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environment30 Mar 2024
- 2024Human Shape and Clothing Estimation28 Feb 2024
- 2024Multi-RoI Human Mesh Recovery with Camera Consistency and Contrastive Losses3 Feb 2024
12 newest of 42 All 42 (JSON)