mlsanityData to 14 Oct 2026

Inter-X: Towards Versatile Human-Human Interaction Analysis

arXiv 2312.16051 ↗First posted 26 Dec 2023cs.CVcited by 98

Not on the map. Why?

Abstract (arXiv)

The analysis of the ubiquitous human-human interactions is pivotal for understanding humans as social beings. Existing human-human interaction datasets typically suffer from inaccurate body motions, lack of hand gestures and fine-grained textual descriptions. To better perceive and generate human-human interactions, we propose Inter-X, a currently largest human-human interaction dataset with accurate body movements and diverse interaction patterns, together with detailed hand gestures. The dataset includes ~11K interaction sequences and more than 8.1M frames. We also equip Inter-X with versatile annotations of more than 34K fine-grained human part-level textual descriptions, semantic interaction categories, interaction order, and the relationship and personality of the subjects. Based on the elaborate annotations, we propose a unified benchmark composed of 4 categories of downstream tasks from both the perceptual and generative directions. Extensive experiments and comprehensive analysis show that Inter-X serves as a testbed for promoting the development of versatile human-human interaction analysis. Our dataset and benchmark will be publicly available for research purposes.

Key facts. Cited by 98 papers in the map (data through 14 Oct 2026). Builds on 69 of its 104 references that are in the map. First posted on arXiv 26 Dec 2023.

Builds on

69 of 104 references.

References · 69

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  7. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  9. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  10. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  11. 2022Human Motion Diffusion Modelcited by 1,080
  12. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
38 more
  1. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  2. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  3. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 533
  4. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  5. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  6. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  7. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  8. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  9. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  10. 2022Multimodal Learning with Transformers: A Surveycited by 400
  11. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  12. 2023Human Motion Diffusion as a Generative Priorcited by 357
  13. 2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognitioncited by 343
  14. 2016The KIT Motion-Language Datasetcited by 338
  15. 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 322
  16. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
  17. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  18. 2019Language2Pose: Natural Language Grounded Pose Forecastingcited by 257
  19. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
  20. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  21. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  22. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  23. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  24. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  25. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 158
  26. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 158
  27. 2019Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognitioncited by 135
  28. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
  29. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  30. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  31. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  32. 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
  33. 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
  34. 2022Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 85
  35. 2018Learning to Detect and Track Visible and Occluded Body Joints in a Virtual Worldcited by 82
  36. 2019You2Me: Inferring Body Pose in Egocentric Video via First and Second Person Interactionscited by 82
  37. 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
  38. 2022Deep Model Reassemblycited by 78

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 16; 2025: 50; 2026: 32.

98 papers.

Sort:

By area:

  1. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  2. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  3. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
  4. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  5. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  6. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  7. 2024HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objectscited by 36
  8. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
  9. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  10. 2025Ready-to-React: Online Reaction Policy for Two-Character Interaction Generationcited by 28
  11. 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
  12. 2025A Survey on Human Interaction Motion Generationcited by 25
38 more
  1. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
  2. 2025Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesiscited by 20
  3. 2024SOLAMI: Social Vision-Language-Action Modeling for Immersive Interaction with 3D Autonomous Characterscited by 18
  4. 2024MMHead: Towards Fine-grained Multi-modal 3D Facial Animationcited by 16
  5. 2025SemGeoMo: Dynamic Contextual Human Motion Generation with Semantic and Geometric Guidancecited by 16
  6. 2025HERO: Human Reaction Generation from Videoscited by 15
  7. 2024Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenescited by 14
  8. 2024MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotationscited by 14
  9. 2024SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesiscited by 14
  10. 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
  11. 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokenscited by 11
  12. 2025Co3Gesture: Towards Coherent Concurrent Co-speech 3D Gesture Generation with Interactive Diffusioncited by 9
  13. 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitizationcited by 9
  14. 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groupscited by 9
  15. 2024You Think, You ACT: The New Task of Arbitrary Text to Motion Generationcited by 8
  16. 2025Multi-Person Interaction Generation from Two-Person Motion Priorscited by 8
  17. 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
  18. 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactionscited by 8
  19. 2024InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarioscited by 7
  20. 20253D Human Interaction Generation: A Surveycited by 7
  21. 2025ARFlow: Human Action-Reaction Flow Matching with Physical Guidancecited by 7
  22. 2025GenHOI: Generalizing Text-driven 4D Human-Object Interaction Synthesis for Unseen Objectscited by 7
  23. 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animationcited by 7
  24. 2025GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interactioncited by 7
  25. 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Modelscited by 6
  26. 2026Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrationscited by 6
  27. 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animationcited by 6
  28. 2025Text-Driven 3D Hand Motion Generation from Sign Language Datacited by 5
  29. 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editingcited by 5
  30. 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 5
  31. 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 5
  32. 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priorscited by 5
  33. 2024CrowdMoGen: Zero-Shot Text-Driven Collective Motion Generationcited by 4
  34. 2025Dyadic Mamba: Long-term Dyadic Human Motion Synthesiscited by 4
  35. 2025PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generationcited by 4
  36. 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoningcited by 4
  37. 2025Event-Driven Storytelling with Multiple Lifelike Humans in a 3D Scenecited by 4
  38. 2025MDD: A Dataset for Text-and-Music Conditioned Duet Dance Generationcited by 4

50 most cited of 98 All 98 (JSON)