Per-Stroke Temporal Control for Text-to-Motion via Action Units and Action-Detection Guidance
Not on the map. Why?
Abstract (arXiv)
Text-to-motion models are competent at the action a prompt names but unreliable at when each stroke lands: four punches alternating left and right rarely return four separable strokes. We introduce typed temporal events called Action Units (AUs) that make the individual stroke -- its body track, action class, time window, and impact timing -- an explicit conditioning signal. We ground a frozen text-to-motion backbone on the AU set through a lightweight gated adapter injecting two streams (per-stroke tokens and a per-frame phase channel), and at inference close residual timing errors with a training-free classifier gradient from a frozen frame-level detector. We measure per-stroke control on StrokeBench, whose prompts specify count, ordering, track, and core-frame placement, paired with an audited stroke corpus. AU grounding markedly raises the rate of correctly placed single strokes over the strongest prior interface, at the best motion quality among text-, interval-, and frame-level baselines. The prompted core frame emerges as a further steerable axis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 42 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
39 of 42 references.
References · 39
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
27 more
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2016The KIT Motion-Language Datasetcited by 338
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2021ASFormer: Transformer for Action Segmentationcited by 168
- 2023MMM: Generative Masked Motion Modelcited by 131
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2023Human Motion Generation: A Surveycited by 96
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
- 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
- 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
- 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 55
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 45
- 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
- 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
- 2024Unimotion: Unifying 3D Human Motion Synthesis and Understandingcited by 30
- 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
- 2026FrankenMotion: Part-level Human Motion Generation and Compositioncited by 10
- 2025FineXtrol: Controllable Motion Generation via Fine-Grained Textcited by 4
- 2026KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motioncited by 1
Built on by
Not cited yet.