mlsanityData to 14 Oct 2026

PRISM: Streaming Human Motion Generation with Per-Joint Latent Decomposition

arXiv 2603.08590 ↗First posted 9 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Text-to-motion generation has advanced with larger corpora and stronger generators, yet many models still rely on holistic frame- or clip-level latents that entangle trajectory, orientation, and articulation. This entanglement obscures body topology and forces the generator to recover kinematic structure implicitly. We present name, a SMPL motion generation framework that factorizes motion into continuous kinematic-unit latents. A causal Motion VAE maps motion to a time-by-kinematic-unit latent manifold, and a Kinematic-Unit Flow Transformer performs text-conditioned flow matching in this structured space. Because each latent coordinate remains tied to a physical body unit, name can use kinematic-tree rotary position encoding and kinematic-adaptive flow scheduling. We further train the generator with per-token timesteps over clean-context/noisy-target masks, enabling frame-conditioned continuation and autoregressive segment chaining within one model. Experiments first validate the representation: the kinematic-unit VAE achieves lower geometry, rotation, and feature errors than existing motion tokenizers, showing that the latent space preserves articulated structure rather than merely compressing frames. With a 1.4B-parameter generator trained only on publicly available academic motion--text data, name outperforms all evaluated academic-data text-to-motion baselines and remains competitive with systems trained on much larger non-public motion corpora. Without task-specific retraining, the same formulation also improves prefix-conditioned generation, BABEL sequential rollout, and narrative motion composition. These results indicate that kinematic-unit latent factorization provides an effective generation substrate for controllable SMPL motion synthesis. Code will be released at https://github.com/ZeyuLing/PRISM.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

45 of 58 references.

References · 45

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  9. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  12. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
33 more
  1. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  2. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  3. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  4. 2023Human Motion Diffusion as a Generative Priorcited by 357
  5. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  6. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  7. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  8. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  9. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  10. 2023MMM: Generative Masked Motion Modelcited by 131
  11. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  12. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  13. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  14. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  15. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
  16. 2022UDE: A Unified Driving Engine for Human Motion Generationcited by 67
  17. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  18. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  19. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  20. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 47
  21. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  22. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 41
  23. 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38
  24. 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
  25. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
  26. 2023AMD: Autoregressive Motion Diffusioncited by 30
  27. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  28. 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 26
  29. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
  30. 2024UniMuMo: Unified Text, Music and Motion Generationcited by 19
  31. 2024DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decodingcited by 19
  32. 2024VersatileMotion: A Unified Framework for Motion Synthesis and Comprehensioncited by 9
  33. 2024MCM: Multi-condition Motion Synthesis Frameworkcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MotionHiFlow: Text-to-motion via hierarchical flow matching
  2. 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
  3. 2026FlowCoMotion: Text-to-Motion Generation via Token-Latent Flow Modeling
  4. 2026Image Diffusion Models Are Good 3D Human Motion Generators
  5. 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation
  6. 2026Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation
  7. 2026Learning Long-term Motion Embeddings for Efficient Kinematics Generation
  8. 2025Absolute Coordinates Make Motion Generation Easy