mlsanityData to 14 Oct 2026

Per-Stroke Temporal Control for Text-to-Motion via Action Units and Action-Detection Guidance

arXiv 2607.15717 ↗First posted 17 Jul 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-motion models are competent at the action a prompt names but unreliable at when each stroke lands: four punches alternating left and right rarely return four separable strokes. We introduce typed temporal events called Action Units (AUs) that make the individual stroke -- its body track, action class, time window, and impact timing -- an explicit conditioning signal. We ground a frozen text-to-motion backbone on the AU set through a lightweight gated adapter injecting two streams (per-stroke tokens and a per-frame phase channel), and at inference close residual timing errors with a training-free classifier gradient from a frozen frame-level detector. We measure per-stroke control on StrokeBench, whose prompts specify count, ordering, track, and core-frame placement, paired with an audited stroke corpus. AU grounding markedly raises the rate of correctly placed single strokes over the strongest prior interface, at the best motion quality among text-, interval-, and frame-level baselines. The prompted core frame emerges as a further steerable axis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 42 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

39 of 42 references.

References · 39

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  4. 2022Human Motion Diffusion Modelcited by 1,080
  5. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  9. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  10. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  11. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  12. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
27 more
  1. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  2. 2016The KIT Motion-Language Datasetcited by 338
  3. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  4. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  5. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  6. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  7. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  8. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  9. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  10. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  11. 2021ASFormer: Transformer for Action Segmentationcited by 168
  12. 2023MMM: Generative Masked Motion Modelcited by 131
  13. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  14. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  15. 2023Human Motion Generation: A Surveycited by 96
  16. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  17. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  18. 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
  19. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
  20. 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 45
  21. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
  22. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
  23. 2024Unimotion: Unifying 3D Human Motion Synthesis and Understandingcited by 30
  24. 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
  25. 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
  26. 2025FineXtrol: Controllable Motion Generation via Fine-Grained Textcited by 4
  27. 2026KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motioncited by 1

Built on by

Not cited yet.