mlsanityData to 7 Oct 2026

InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation

arXiv 2607.01743 ↗First posted 2 Jul 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-conditioned human interaction generation must capture both long-range temporal causality within each individual and tightly coupled coordination between partners. Existing interaction diffusion models typically denoise full sequences using bidirectional attention, which obscures causality and hinders streaming and long-horizon generation. Autoregressive alternatives enforce causality but often suffer from temporal drift, leading to coordination degradation and unstable interaction dynamics over time. We propose InterCMDM, a block-causal latent diffusion framework for autoregressive two-person interaction generation. InterCMDM introduces a Dual-Stream Causal Diffusion Transformer that maintains separate causal streams for each person while modeling inter-person dependencies via unified dual-stream attention with multi-task attention masks. These masks unify interaction modeling within a single attention mechanism and support diverse coordination behaviors, including simultaneous actions, reactive responses, leader-follower dynamics, and independent motion. By training a single model across these mask configurations as a form of data augmentation, InterCMDM enables controllable interaction generation by simply selecting the desired attention mask at inference time. Finally, a block-wise diffusion objective enables stable latent rollout over long sequences without repeated decode-encode cycles. InterCMDM achieves state-of-the-art performance on InterHuman and Inter-X, improving text-motion alignment, realism, and long-horizon continuity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

56 of 60 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Causal Motion Diffusion Models for Autoregressive Motion Generation26 Feb
  2. 2025Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models22 Dec
  3. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing18 Mar
  4. 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Space19 Dec
  5. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  6. 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
  7. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions12 Apr
  8. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  9. 2023Human Motion Diffusion as a Generative Prior2 Mar
  10. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  11. 2022Human Motion Diffusion Model29 Sep
  12. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  9. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  10. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  11. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  12. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
32 more
  1. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  2. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  3. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  4. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  5. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  6. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  7. 2016The KIT Motion-Language Datasetcited by 334
  8. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  9. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  10. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  11. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  12. 2023MMM: Generative Masked Motion Modelcited by 129
  13. 2019Generalization in Generation: A closer look at Exposure Biascited by 123
  14. 2023Elucidating the Exposure Bias in Diffusion Modelscited by 98
  15. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  16. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  17. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  18. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  19. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  20. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 77
  21. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
  22. 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
  23. 2023Digital Life Project: Autonomous 3D Characters with Social Intelligencecited by 43
  24. 2024in2IN: Leveraging individual Information to Generate Human INteractionscited by 29
  25. 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
  26. 2025Ready-to-React: Online Reaction Policy for Two-Character Interaction Generationcited by 25
  27. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  28. 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
  29. 2025ReMoMask: Retrieval-Augmented Masked Motion Generationcited by 11
  30. 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 10
  31. 2026HINT: Hierarchical Interaction Modeling for Autoregressive Multi-Human Motion Generationcited by 4
  32. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modeling
  2. 2026ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions
  3. 2025Multi-Person Interaction Generation from Two-Person Motion Priors
  4. 2025Latent Behavior Diffusion for Sequential Reaction Generation in Dyadic Setting
  5. 2025Auto-Regressive Diffusion for Generating 3D Human-Object Interactions
  6. 2024ReGenNet: Towards Human Action-Reaction Synthesis
  7. 2026ResDiffFRG: Residual Diffusion for Multiple Appropriate Facial Reaction Generation
  8. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction