MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance
Not on the map. Why?
Abstract (arXiv)
Text-to-motion generation has progressed rapidly in recent years, offering an expressive interface for animation and human-computer interaction. However, current models remain brittle when handling prompts that describe multiple actions occurring at the same time. Rather than realizing all components of a composite description, models frequently prioritize a single dominant action and neglect the rest, leading to incomplete or ambiguous motion. We present MultiAct, an unpaired, inference-time framework for compositional text-to-motion synthesis that operates directly on pretrained motion generators without retraining or architectural modification. Our method counteracts semantic collapse by adaptively amplifying cross-attention scores associated with underrepresented prompt components. We note that effective modulation depends on prompt-specific choices, such as which tokens and layers to target, and introduce a lightweight auxiliary decision scheme that determines the most effective attention-strengthening parametrization. Extensive quantitative and qualitative evaluations demonstrate that MultiAct consistently outperforms existing baselines on composite prompts, achieving improved semantic coverage while preserving motion realism. Project page: https://natsala13.github.io/multiact.github.io.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 68 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
39 of 68 references.
References · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
27 more
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
- 2025SnapMoGen: Human Motion Generation from Expressive Textscited by 47
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 45
- 2025MotionGPT3: Human Motion as a Second Modalitycited by 37
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 31
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
- 2025ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignmentcited by 13
- 2024Local Action-Guided Motion Diffusion Model for Text-to-Motion Generationcited by 10
- 2025CASIM: Composite Aware Semantic Injection for Text to Motion Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.