mlsanityData to 14 Oct 2026

HINT: Hierarchical Interaction Modeling for Autoregressive Multi-Human Motion Generation

arXiv 2601.20383 ↗First posted 28 Jan 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Text-driven multi-human motion generation with complex interactions remains a challenging problem. Despite progress in performance, existing offline methods that generate fixed-length motions with a fixed number of agents, are inherently limited in handling long or variable text, and varying agent counts. These limitations naturally encourage autoregressive formulations, which predict future motions step by step conditioned on all past trajectories and current text guidance. In this work, we introduce HINT, the first autoregressive framework for multi-human motion generation with Hierarchical INTeraction modeling in diffusion. First, HINT leverages a disentangled motion representation within a canonicalized latent space, decoupling local motion semantics from inter-person interactions. This design facilitates direct adaptation to varying numbers of human participants without requiring additional refinement. Second, HINT adopts a sliding-window strategy for efficient online generation, and aggregates local within-window and global cross-window conditions to capture past human history, inter-person dependencies, and align with text guidance. This strategy not only enables fine-grained interaction modeling within each window but also preserves long-horizon coherence across all the long sequence. Extensive experiments on public benchmarks demonstrate that HINT matches the performance of strong offline models and surpasses autoregressive baselines. Notably, on InterHuman, HINT achieves an FID of 3.100, significantly improving over the previous state-of-the-art score of 5.154.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 31 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

28 of 31 references.

References · 28

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  3. 2022Human Motion Diffusion Modelcited by 1,080
  4. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  5. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  6. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  7. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  8. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  9. 2023Human Motion Diffusion as a Generative Priorcited by 357
  10. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  11. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
  12. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
16 more
  1. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  2. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  3. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  4. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  5. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
  6. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  7. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  8. 2023Digital Life Project: Autonomous 3D Characters with Social Intelligencecited by 43
  9. 2022Interaction Transformer for Human Reaction Generationcited by 42
  10. 2024in2IN: Leveraging individual Information to Generate Human INteractionscited by 29
  11. 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 23
  12. 2024PhysReaction: Physically Plausible Real-Time Humanoid Reaction Synthesis via Forward Dynamics Guided 4D Imitationcited by 18
  13. 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
  14. 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groupscited by 9
  15. 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
  16. 2025Multi-Person Interaction Generation from Two-Person Motion Priorscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.