mlsanityData to 7 Oct 2026

MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

arXiv 2609.34190 ↗First posted 28 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimensional, temporally downsampled latent spaces learned primarily for reconstruction, a bottleneck that can limit generation quality and preclude direct manipulation of individual frames and joints. We introduce MotionSpaceFlow (MSFlow), a representation-aware flow-matching framework that predicts clean motion directly in continuous motion space without a learned encoder or decoder. To account for the anisotropic structure of direct motion representations, we propose representation-aware noise scaling and show how the initial Gaussian source scale governs the covariance of intermediate probability-path marginals. We further introduce a Representation-Aware Multimodal Diffusion Transformer (RA-MMDiT), which jointly updates token-level language and full-resolution motion features through joint attention while adapting temporal information flow to the motion representation: causal attention for incremental features defined by frame-to-frame changes, and bidirectional attention for global features such as absolute joint coordinates. Across different datasets and motion representations, MSFlow achieves state-of-the-art text-to-motion performance. Its global representation variant additionally enables zero-shot, inference-time control over any joint or frame through projection sampling without control-conditioned training, delivering leading motion quality with exact constraint satisfaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 65 of its 73 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

65 of 73 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation7 Jul
  2. 2026Causal Motion Diffusion Models for Autoregressive Motion Generation26 Feb
  3. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec
  4. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing18 Mar
  5. 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Space19 Dec
  6. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesis14 Oct
  7. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Framework9 May
  8. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
  9. 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
  10. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  11. 2023Human Motion Diffusion as a Generative Prior2 Mar
  12. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
2 more
  1. 2022Human Motion Diffusion Model29 Sep
  2. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 51

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  11. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  12. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
38 more
  1. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  2. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  3. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  4. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  5. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  6. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  8. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  9. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  10. 2025Diffusion Transformers with Representation Autoencoderscited by 275
  11. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  12. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  13. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  14. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  15. 2023MMM: Generative Masked Motion Modelcited by 129
  16. 2019Generalization in Generation: A closer look at Exposure Biascited by 123
  17. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  18. 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
  19. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  20. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  21. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  22. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  23. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  24. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 63
  25. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
  26. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 44
  27. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
  28. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  29. 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 22
  30. 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
  31. 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
  32. 2024The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image Generationcited by 14
  33. 2025FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generationcited by 14
  34. 2024Chronologically Accurate Retrieval for Temporal Grounding of Motion-Language Modelscited by 12
  35. 2025It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion Modelscited by 9
  36. 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priorscited by 5
  37. 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 4
  38. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MotionHiFlow: Text-to-motion via hierarchical flow matching
  2. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
  3. 2026Learning Long-term Motion Embeddings for Efficient Kinematics Generation
  4. 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
  5. 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition
  6. 2023Priority-Centric Human Motion Generation in Discrete Latent Space
  7. 2026Timo: Taming Multimodal Diffusion Transformer for Human Motion Generation
  8. 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3