mlsanityData to 14 Oct 2026

ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions

arXiv 2607.05733 ↗First posted 7 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating temporally continuous and socially coherent human motion from text remains a fundamental challenge, particularly in realistic streams where people act alone, enter interactions, and later disengage. Most existing methods generate fixed-length motion clips under static agent configurations, which makes them brittle to solo-social transitions and unsuitable for incremental generation over long horizons. We propose ARMS, an Anchor-Relational Motion Streaming framework that unifies solo motion and human-human interaction within a single causal generative process. ARMS introduces a dynamics-asymmetric representation that decouples per-person temporal evolution from inter-person alignment via a partner-referenced relative-translation term, enabling seamless switching of social coupling without sacrificing long-horizon stability or spatial consistency between agents. On top of a causal latent space, a causal relational diffusion model progressively refines motion segment by segment using only past context, capturing both intra-person temporal dependencies and inter-person relations. Mode-aware relational gating activates or masks cross-agent connections, allowing the same model to support both solo and interaction generation. Experiments show that ARMS improves transition smoothness and social coherence compared to interaction-centric baselines, while also achieving competitive results on human-human interaction benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 62 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

56 of 62 references.

References · 56

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  9. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  10. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
38 more
  1. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  2. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  3. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  4. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  5. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  6. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  7. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  8. 2023Human Motion Diffusion as a Generative Priorcited by 357
  9. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  10. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  11. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 190
  12. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  13. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  14. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
  15. 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 105
  16. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  17. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  18. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  19. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  20. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  21. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
  22. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
  23. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  24. 2023Digital Life Project: Autonomous 3D Characters with Social Intelligencecited by 43
  25. 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
  26. 2024in2IN: Leveraging individual Information to Generate Human INteractionscited by 29
  27. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  28. 2025Ready-to-React: Online Reaction Policy for Two-Character Interaction Generationcited by 28
  29. 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
  30. 2025A Survey on Human Interaction Motion Generationcited by 25
  31. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  32. 2024Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenescited by 14
  33. 2025PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learningcited by 14
  34. 2025SocialGen: Modeling Multi-Human Social Interaction with Language Modelscited by 14
  35. 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
  36. 2024InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillationcited by 12
  37. 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 11
  38. 2026Causal Motion Diffusion Models for Autoregressive Motion Generationcited by 10

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation
  2. 2025Multi-Person Interaction Generation from Two-Person Motion Priors
  3. 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modeling
  4. 2026DyaDiT: A Multi-Modal Diffusion Transformer for Socially Favorable Dyadic Gesture Generation
  5. 2026GestureFAR: Streaming Co-Speech Gesture Generation with Flow Autoregression
  6. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction
  7. 2026ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction
  8. 2023Synthesizing Long-Term Human Motions with Diffusion Models via Coherent Sampling