mlsanityData to 14 Oct 2026

Diverse 3D Human Pose Generation in Scenes based on Decoupled Structure

arXiv 2406.05691 ↗First posted 9 Jun 2024cs.CV cs.GRcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel method for generating diverse 3D human poses in scenes with semantic control. Existing methods heavily rely on the human-scene interaction dataset, resulting in a limited diversity of the generated human poses. To overcome this challenge, we propose to decouple the pose and interaction generation process. Our approach consists of three stages: pose generation, contact generation, and putting human into the scene. We train a pose generator on the human dataset to learn rich pose prior, and a contact generator on the human-scene interaction dataset to learn human-scene contact prior. Finally, the placing module puts the human body into the scene in a suitable and natural manner. The experimental results on the PROX dataset demonstrate that our method produces more physically plausible interactions and exhibits more diverse human poses. Furthermore, experiments on the MP3D-R dataset further validates the generalization ability of our method.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 9 Jun 2024.

Builds on

19 of 28 references.

References · 19

  1. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  4. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  5. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  6. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
  7. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  8. 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
  9. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
  10. 2019Generating 3D People in Scenes without Peoplecited by 127
  11. 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
  12. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
7 more
  1. 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 90
  2. 2019SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operatorcited by 89
  3. 2022Compositional Human-Scene Interaction Synthesis with Semantic Controlcited by 83
  4. 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
  5. 2023GenZI: Zero-Shot 3D Human-Scene Interaction Generationcited by 40
  6. 2023Scene Synthesis from Human Motioncited by 20
  7. 2023Reconstructing 3D Human Pose from RGB-D Data with Occlusionscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.