mlsanityData to 14 Oct 2026

Event-T2M: Event-level Conditioning for Complex Text-to-Motion Synthesis

arXiv 2602.04292 ↗First posted 4 Feb 2026cs.GRcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-to-motion generation has advanced with diffusion models, yet existing systems often collapse complex multi-action prompts into a single embedding, leading to omissions, reordering, or unnatural transitions. In this work, we shift perspective by introducing a principled definition of an event as the smallest semantically self-contained action or state change in a text prompt that can be temporally aligned with a motion segment. Building on this definition, we propose Event-T2M, a diffusion-based framework that decomposes prompts into events, encodes each with a motion-aware retrieval model, and integrates them through event-based cross-attention in Conformer blocks. Existing benchmarks mix simple and multi-event prompts, making it unclear whether models that succeed on single actions generalize to multi-action cases. To address this, we construct HumanML3D-E, the first benchmark stratified by event count. Experiments on HumanML3D, KIT-ML, and HumanML3D-E show that Event-T2M matches state-of-the-art baselines on standard tests while outperforming them as event complexity increases. Human studies validate the plausibility of our event definition, the reliability of HumanML3D-E, and the superiority of Event-T2M in generating multi-event motions that preserve order and naturalness close to ground-truth. These results establish event-level conditioning as a generalizable principle for advancing text-to-motion generation beyond single-action prompts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 30 of its 35 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

30 of 35 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing22 Dec
  2. 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphs2 Nov
  3. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model3 Apr
  4. 2022Executing your Commands via Motion Diffusion in Latent Space8 Dec
  5. 2022Human Motion Diffusion Model29 Sep
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  7. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  8. 2016Language Modeling with Gated Convolutional Networkscited by 702
  9. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  10. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  11. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  12. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
12 more
  1. 2016The KIT Motion-Language Datasetcited by 338
  2. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  3. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  4. 2023MMM: Generative Masked Motion Modelcited by 131
  5. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  6. 2019Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of Viewcited by 113
  7. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
  8. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  9. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 41
  10. 2020High-Fidelity Neural Human Motion Transfer from Monocular Videocited by 31
  11. 2024Light-T2M: A Lightweight and Fast Model for Text-to-motion Generationcited by 23
  12. 2023From Text to Motion: Grounding GPT-4 in a Humanoid Robot "Alter3"cited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models
  2. 2026Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions
  3. 2024Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation
  4. 2025PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
  5. 2023AMD: Autoregressive Motion Diffusion
  6. 2025MOST: Motion Diffusion Model for Rare Text via Temporal Clip Banzhaf Interaction
  7. 2024AToM: Aligning Text-to-Motion Model at Event-Level with GPT-4Vision Reward
  8. 2023Priority-Centric Human Motion Generation in Discrete Latent Space