3D Human Interaction Generation: A Survey
Not on the map. Why?
Abstract (arXiv)
3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation methods, motion capture technologies, and generative models have laid a solid foundation for the growing interest in this domain. Existing research in this field can be broadly categorized into three areas: human-scene interaction, human-object interaction, and human-human interaction. Despite the rapid advancements in this area, challenges remain due to the need for naturalness in human motion generation and the accurate interaction between humans and interactive entities. In this survey, we present a comprehensive literature review of human interaction generation, which, to the best of our knowledge, is the first of its kind. We begin by introducing the foundational technologies, including model representations, motion capture methods, and generative models. Subsequently, we introduce the approaches proposed for the three sub-tasks, along with their corresponding datasets and evaluation metrics. Finally, we discuss potential future research directions in this area and conclude the survey. Through this survey, we aim to offer a comprehensive overview of the current advancements in the field, highlight key challenges, and inspire future research works.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 172 of its 236 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
172 of 236 references.
References · 172
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Neural Discrete Representation Learningcited by 4,712
38 more
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Video Diffusion Modelscited by 2,305
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2022Human Motion Diffusion Modelcited by 1,080
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 533
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2019Human Motion Trajectory Prediction: A Surveycited by 232
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
- 2023Object Motion Guided Human Motion Synthesiscited by 212
50 most cited of 172 All 172 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Modelscited by 6
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Multimodal Priors-Augmented Text-Driven 3D Human-Object Interaction Generationcited by 2
- 2026Social Structure Matters in 3D Human-Human Interaction Generationcited by 1
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0
- 2026MIME: Multimodal Interactive Motion Encodercited by 0
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Surveycited by 0
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Survey18 Aug 2026
- 2026MIME: Multimodal Interactive Motion Encoder18 Jul 2026
- 2026Social Structure Matters in 3D Human-Human Interaction Generation23 Jun 2026
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors4 Mar 2026
- 2026Multimodal Priors-Augmented Text-Driven 3D Human-Object Interaction Generation11 Feb 2026
- 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models22 Dec 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025