MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimensional, temporally downsampled latent spaces learned primarily for reconstruction, a bottleneck that can limit generation quality and preclude direct manipulation of individual frames and joints. We introduce MotionSpaceFlow (MSFlow), a representation-aware flow-matching framework that predicts clean motion directly in continuous motion space without a learned encoder or decoder. To account for the anisotropic structure of direct motion representations, we propose representation-aware noise scaling and show how the initial Gaussian source scale governs the covariance of intermediate probability-path marginals. We further introduce a Representation-Aware Multimodal Diffusion Transformer (RA-MMDiT), which jointly updates token-level language and full-resolution motion features through joint attention while adapting temporal information flow to the motion representation: causal attention for incremental features defined by frame-to-frame changes, and bidirectional attention for global features such as absolute joint coordinates. Across different datasets and motion representations, MSFlow achieves state-of-the-art text-to-motion performance. Its global representation variant additionally enables zero-shot, inference-time control over any joint or frame through projection sampling without control-conditioned training, delivering leading motion quality with exact constraint satisfaction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 65 of its 73 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
65 of 73 references.
Closest ancestors · 14
Same direction, newest first
- 2026Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation7 Jul
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation26 Feb
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation29 Dec
- 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing18 Mar
- 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Space19 Dec
- 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesis14 Oct
- 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Framework9 May
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model30 Apr
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesis21 May
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
- 2023Human Motion Diffusion as a Generative Prior2 Mar
- 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
2 more
Other references · 51
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
38 more
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
- 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
- 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 63
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 44
- 2026Kimodo: Scaling Controllable Human Motion Generationcited by 33
- 2025Absolute Coordinates Make Motion Generation Easycited by 27
- 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 22
- 2024Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patchescited by 22
- 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
- 2024The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image Generationcited by 14
- 2025FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generationcited by 14
- 2024Chronologically Accurate Retrieval for Temporal Grounding of Motion-Language Modelscited by 12
- 2025It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion Modelscited by 9
- 2026UMO: Unified In-Context Learning Unlocks Motion Foundation Model Priorscited by 5
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 4
- 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
- 2026Learning Long-term Motion Embeddings for Efficient Kinematics Generation
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
- 2026PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition
- 2023Priority-Centric Human Motion Generation in Discrete Latent Space
- 2026Timo: Taming Multimodal Diffusion Transformer for Human Motion Generation
- 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3