MoGIC: Boosting Motion Generation via Intention Understanding and Visual Context
Not on the map. Why?
Abstract (arXiv)
Existing text-driven motion generation methods often treat synthesis as a bidirectional mapping between language and motion, but remain limited in capturing the causal logic of action execution and the human intentions that drive behavior. The absence of visual grounding further restricts precision and personalization, as language alone cannot specify fine-grained spatiotemporal details. We propose MoGIC, a unified framework that integrates intention modeling and visual priors into multimodal motion synthesis. By jointly optimizing multimodal-conditioned motion generation and intention prediction, MoGIC uncovers latent human goals, leverages visual priors to enhance generation, and exhibits versatile multimodal generative capability. We further introduce a mixture-of-attention mechanism with adaptive scope to enable effective local alignment between conditional tokens and motion subsequences. To support this paradigm, we curate Mo440H, a 440-hour benchmark from 21 high-quality motion datasets. Experiments show that after finetuning, MoGIC reduces FID by 38.6% on HumanML3D and 34.6% on Mo440H, surpasses LLM-based methods in motion captioning with a lightweight text head, and further enables intention prediction and vision-conditioned generation, advancing controllable motion synthesis and intention understanding. The code is available at https://github.com/JunyuShi02/MoGIC
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 55 of its 59 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
55 of 59 references.
References · 55
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
38 more
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2023Human Motion Diffusion as a Generative Priorcited by 354
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2021Robust Motion In-betweeningcited by 223
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
- 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 111
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
- 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
- 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 101
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
- 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
- 2022Full-Body Articulated Human-Object Interactioncited by 76
- 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 58
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 54
- 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
- 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
- 2023I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactionscited by 42
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
- 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.