mlsanityData to 14 Oct 2026

Exploring Motion-Language Alignment for Text-driven Motion Generation

arXiv 2604.02973 ↗First posted 3 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-driven human motion generation aims to synthesize realistic motion sequences that follow textual descriptions. Despite recent advances, accurately aligning motion dynamics with textual semantics remains a fundamental challenge. In this paper, we revisit text-to-motion generation from the perspective of motion-language alignment and propose MLA-Gen, a framework that integrates global motion priors with fine-grained local conditioning. This design enables the model to capture common motion patterns, while establishing detailed alignment between texts and motions. Furthermore, we identify a previously overlooked attention sink phenomenon in human motion generation, where attention disproportionately concentrates on the start text token, limiting the utilization of informative textual cues and leading to degraded semantic grounding. To analyze this issue, we introduce SinkRatio, a metric for measuring attention concentration, and develop alignment-aware masking and control strategies to regulate attention during generation. Extensive experiments demonstrate that our approach consistently improves both motion quality and motion-language alignment over strong baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

46 of 65 references.

References · 46

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  6. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  7. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  9. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  12. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
34 more
  1. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  2. 2023Human Motion Diffusion as a Generative Priorcited by 357
  3. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  4. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  5. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
  6. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
  7. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  8. 2024When Attention Sink Emerges in Language Models: An Empirical Viewcited by 208
  9. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  10. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  11. 2025Why do LLMs attend to the first token?cited by 127
  12. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 114
  13. 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
  14. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  15. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  16. 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 68
  17. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  18. 2025Sparse-dLLM: Accelerating Diffusion LLMs with Dynamic Cache Evictioncited by 65
  19. 2024Taming Diffusion Probabilistic Models for Character Controlcited by 57
  20. 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 52
  21. 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
  22. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  23. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 44
  24. 2024MaskControl: Spatio-Temporal Control for Masked Motion Synthesiscited by 38
  25. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  26. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  27. 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
  28. 2024Rectified Diffusion Guidance for Conditional Generationcited by 18
  29. 2025SparseD: Sparse Attention for Diffusion Language Modelscited by 17
  30. 2025Rectified-CFG++ for Flow Based Modelscited by 17
  31. 2025MotionPCM: Real-Time Motion Synthesis with Phased Consistency Modelcited by 10
  32. 2025MotionDreamer: One-to-Many Motion Synthesis with Localized Generative Masked Transformercited by 9
  33. 2026CFG-Ctrl: Control-Based Classifier-Free Diffusion Guidancecited by 8
  34. 2025LangScene-X: Reconstruct Generalizable 3D Language-Embedded Scenes with TriMap Video Diffusioncited by 6

Built on by

Not cited yet.