mlsanityData to 7 Oct 2026

Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes

arXiv 2209.06314 ↗First posted 13 Sep 2022cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most important meshes in the animation for the interaction with the scene, which we call "keyframes." These keyframes allow us to better optimize the placement of the animation into the scene such that interactions in the animations (standing, laying, sitting, etc.) match the affordances of the scene (e.g., standing on the floor or laying in a bed). We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study. Human raters preferred our PAAK method over the PROX ground truth data 64.6% of the time. Additionally, in direct comparisons, the raters preferred PAAK over competing methods including 61.5% compared to POSA.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 13 Sep 2022.

Builds on

30 of 67 references.

References · 30

  1. 2022Generative Adversarial Networkscited by 5,603
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  3. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  4. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  5. 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
  6. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  7. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  8. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  9. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  10. 2020Critic Regularized Regressioncited by 269
  11. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  12. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
18 more
  1. 2021Robust Motion In-betweeningcited by 223
  2. 2021Neural Articulated Radiance Fieldcited by 196
  3. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  4. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  5. 2021Character Controllers Using Motion VAEscited by 182
  6. 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
  7. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  8. 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
  9. 2019Generating 3D People in Scenes without Peoplecited by 127
  10. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  11. 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
  12. 2019Active Adversarial Domain Adaptationcited by 73
  13. 2019Putting Humans in a Scene: Learning Affordance in 3D Indoor Environmentscited by 72
  14. 2020Active Domain Adaptation via Clustering Uncertainty-weighted Embeddingscited by 71
  15. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  16. 2020Hierarchical Style-based Networks for Motion Synthesiscited by 23
  17. 2017Where and Who? Automatic Semantic-Aware Person Compositioncited by 21
  18. 2020Pose to Seat: Automated Design of Body-Supporting Surfacescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 2.

8 papers.

  1. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  2. 2025A Survey on Human Interaction Motion Generationcited by 25
  3. 2024Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenescited by 14
  4. 2024Diffusion Implicit Policy for Unpaired Scene-aware Motion Synthesiscited by 6
  5. 2023PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environmentscited by 0
  6. 2024DEMOS: Dynamic Environment Motion Synthesis in 3D Scenes via Local Spherical-BEV Perceptioncited by 0
  7. 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitionscited by 0
  8. 2026Efficient Human-Contact Representation for Human-Scene Interactioncited by 0