mlsanityData to 14 Oct 2026

3D Human Interaction Generation: A Survey

arXiv 2503.13120 ↗First posted 17 Mar 2025cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation methods, motion capture technologies, and generative models have laid a solid foundation for the growing interest in this domain. Existing research in this field can be broadly categorized into three areas: human-scene interaction, human-object interaction, and human-human interaction. Despite the rapid advancements in this area, challenges remain due to the need for naturalness in human motion generation and the accurate interaction between humans and interactive entities. In this survey, we present a comprehensive literature review of human interaction generation, which, to the best of our knowledge, is the first of its kind. We begin by introducing the foundational technologies, including model representations, motion capture methods, and generative models. Subsequently, we introduce the approaches proposed for the three sub-tasks, along with their corresponding datasets and evaluation metrics. Finally, we discuss potential future research directions in this area and conclude the survey. Through this survey, we aim to offer a comprehensive overview of the current advancements in the field, highlight key challenges, and inspire future research works.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 172 of its 236 references that are in the map. First posted on arXiv 17 Mar 2025.

Builds on

172 of 236 references.

References · 172

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2022Training language models to follow instructions with human feedbackcited by 15,971
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  9. 2020Denoising Diffusion Implicit Modelscited by 9,781
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  12. 2017Neural Discrete Representation Learningcited by 4,712
38 more
  1. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  5. 2022Video Diffusion Modelscited by 2,305
  6. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  9. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  10. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  11. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  13. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  14. 2022Human Motion Diffusion Modelcited by 1,080
  15. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  16. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  17. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  18. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  19. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  20. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  21. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 533
  22. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  23. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  24. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  25. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  26. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  27. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  28. 2023Human Motion Diffusion as a Generative Priorcited by 357
  29. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  30. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  31. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
  32. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  33. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  34. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  35. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
  36. 2019Human Motion Trajectory Prediction: A Surveycited by 232
  37. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
  38. 2023Object Motion Guided Human Motion Synthesiscited by 212

50 most cited of 172 All 172 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.