mlsanityData to 7 Oct 2026

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

arXiv 2303.17368 ↗First posted 30 Mar 2023cs.CVcited by 54

Not on the map. Why?

Abstract (arXiv)

Synthetic data has emerged as a promising source for 3D human research as it offers low-cost access to large-scale human datasets. To advance the diversity and annotation quality of human models, we introduce a new synthetic dataset, SynBody, with three appealing features: 1) a clothed parametric human model that can generate a diverse range of subjects; 2) the layered human representation that naturally offers high-quality 3D annotations to support multiple tasks; 3) a scalable system for producing realistic data to facilitate real-world tasks. The dataset comprises 1.2M images with corresponding accurate 3D annotations, covering 10,000 human body models, 1,187 actions, and various viewpoints. The dataset includes two subsets for human pose and shape estimation as well as human neural rendering. Extensive experiments on SynBody indicate that it substantially enhances both SMPL and SMPL-X estimation. Furthermore, the incorporation of layered annotations offers a valuable training resource for investigating the Human Neural Radiance Fields (NeRF).

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 40 of its 61 references that are in the map. First posted on arXiv 30 Mar 2023.

Builds on

40 of 61 references.

References · 40

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  7. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  8. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
  9. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
  10. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  11. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  12. 2017Learning from Synthetic Humanscited by 358
28 more
  1. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  2. 2018Learning 3D Human Dynamics from Videocited by 315
  3. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  4. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  5. 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
  6. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
  7. 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
  8. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  9. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  10. 2020Monocular Expressive Body Regression through Body-Driven Attentioncited by 155
  11. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  12. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  13. 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
  14. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
  15. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  16. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  17. 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
  18. 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
  19. 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
  20. 2021Playing for 3D Human Recoverycited by 63
  21. 2020NeuralAnnot: Neural Annotator for 3D Human Mesh Training Setscited by 62
  22. 2021Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimationcited by 62
  23. 2023Zolly: Zoom Focal Length Correctly for Perspective-Distorted Human Mesh Reconstructioncited by 41
  24. 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environmentscited by 29
  25. 2022DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimationcited by 29
  26. 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
  27. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  28. 2014Collaborative Regressioncited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 19; 2025: 18; 2026: 10.

54 papers.

Sort:

By area:

  1. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
  2. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
  3. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  4. 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
  5. 2024AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimationcited by 41
  6. 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
  7. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  8. 2024WHAC: World-grounded Humans and Camerascited by 29
  9. 2024UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified Modelcited by 29
  10. 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
  11. 2024Look Ma, no markers: holistic performance capture without the hasslecited by 23
  12. 2025BEDLAM2.0: Synthetic Humans and Cameras in Motioncited by 21
38 more
  1. 2023Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Imagescited by 20
  2. 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
  3. 2024SOLAMI: Social Vision-Language-Action Modeling for Immersive Interaction with 3D Autonomous Characterscited by 18
  4. 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Imagecited by 17
  5. 2025Towards Autonomous Micromobility through Scalable Urban Simulationcited by 16
  6. 2025Free-Form Motion Control: Controlling the 6D Poses of Camera and Objects in Video Generationcited by 15
  7. 2025EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activitycited by 15
  8. 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 14
  9. 2025Multi-identity Human Image Animation with Structural Video Diffusioncited by 13
  10. 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Datacited by 11
  11. 2025ETCH: Generalizing Body Fitting to Clothed Humans via Equivariant Tightnesscited by 9
  12. 2024Diffusion Models are Efficient Data Generators for Human Mesh Recoverycited by 8
  13. 2024HumanCoser: Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 7
  14. 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
  15. 2026From Frames to Sequences: Temporally Consistent Human-Centric Dense Predictioncited by 7
  16. 2025DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recoverycited by 6
  17. 2023M3Act: Learning from Synthetic Human Group Activitiescited by 5
  18. 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detectioncited by 5
  19. 2024GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstructioncited by 4
  20. 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detectioncited by 4
  21. 2025TalkCuts: A Large-Scale Dataset for Multi-Shot Human Speech Video Generationcited by 4
  22. 2024On the Equivalency, Substitutability, and Flexibility of Synthetic Datacited by 3
  23. 2025DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Videocited by 3
  24. 2025Bringing Your Portrait to 3D Presencecited by 3
  25. 2023Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 2
  26. 2025S2R-HDR: A Large-Scale Rendered Dataset for HDR Fusioncited by 2
  27. 2026OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Predictioncited by 2
  28. 2024Are Pose Estimators Ready for the Open World? STAGE: A GenAI Toolkit for Auditing 3D Human Pose Estimatorscited by 1
  29. 2024ShotVL: Human-Centric Highlight Frame Retrieval via Language Queriescited by 1
  30. 2025UAVTwin: Neural Digital Twins for UAVs using Gaussian Splattingcited by 1
  31. 2025ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Modelscited by 1
  32. 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxiescited by 1
  33. 2024X as Supervision: Contending with Depth Ambiguity in Unsupervised Monocular 3D Pose Estimationcited by 0
  34. 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusionscited by 0
  35. 2025VividCam: Learning Unconventional Camera Motions from Virtual Synthetic Videoscited by 0
  36. 2026PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Modelscited by 0
  37. 2026LEGO: Latent-space Exploration for Geometry-aware Optimization of Humanoid Kinematic Designcited by 0
  38. 2026BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognitioncited by 0

50 most cited of 54 All 54 (JSON)