PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition
Not on the map. Why?
Abstract (arXiv)
Text-to-motion generation has advanced with larger corpora and stronger generators, yet many models still rely on holistic frame- or clip-level latents that entangle trajectory, orientation, and articulation. This entanglement obscures body topology and forces the generator to recover kinematic structure implicitly. We present name, a SMPL motion generation framework that factorizes motion into continuous kinematic-unit latents. A causal Motion VAE maps motion to a time-by-kinematic-unit latent manifold, and a Kinematic-Unit Flow Transformer performs text-conditioned flow matching in this structured space. Because each latent coordinate remains tied to a physical body unit, name can use kinematic-tree rotary position encoding and kinematic-adaptive flow scheduling. We further train the generator with per-token timesteps over clean-context/noisy-target masks, enabling frame-conditioned continuation and autoregressive segment chaining within one model. Experiments first validate the representation: the kinematic-unit VAE achieves lower geometry, rotation, and feature errors than existing motion tokenizers, showing that the latent space preserves articulated structure rather than merely compressing frames. With a 1.4B-parameter generator trained only on publicly available academic motion--text data, name outperforms all evaluated academic-data text-to-motion baselines and remains competitive with systems trained on much larger non-public motion corpora. Without task-specific retraining, the same formulation also improves prefix-conditioned generation, BABEL sequential rollout, and narrative motion composition. These results indicate that kinematic-unit latent factorization provides an effective generation substrate for controllable SMPL motion synthesis. Code will be released at https://github.com/ZeyuLing/PRISM.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
45 of 58 references.
References · 45
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
33 more
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023MMM: Generative Masked Motion Modelcited by 131
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
- 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
- 2022UDE: A Unified Driving Engine for Human Motion Generationcited by 67
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 47
- 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
- 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 41
- 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
- 2023AMD: Autoregressive Motion Diffusioncited by 30
- 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 26
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
- 2024UniMuMo: Unified Text, Music and Motion Generationcited by 19
- 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decodingcited by 19
- 2024VersatileMotion: A Unified Framework for Motion Synthesis and Comprehensioncited by 9
- 2024MCM: Multi-condition Motion Synthesis Frameworkcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026MotionHiFlow: Text-to-motion via hierarchical flow matching
- 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
- 2026FlowCoMotion: Text-to-Motion Generation via Token-Latent Flow Modeling
- 2026Image Diffusion Models Are Good 3D Human Motion Generators
- 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation
- 2026Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation
- 2026Learning Long-term Motion Embeddings for Efficient Kinematics Generation
- 2025Absolute Coordinates Make Motion Generation Easy