mlsanityData to 7 Oct 2026

MoGIC: Boosting Motion Generation via Intention Understanding and Visual Context

arXiv 2510.02722 ↗First posted 3 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing text-driven motion generation methods often treat synthesis as a bidirectional mapping between language and motion, but remain limited in capturing the causal logic of action execution and the human intentions that drive behavior. The absence of visual grounding further restricts precision and personalization, as language alone cannot specify fine-grained spatiotemporal details. We propose MoGIC, a unified framework that integrates intention modeling and visual priors into multimodal motion synthesis. By jointly optimizing multimodal-conditioned motion generation and intention prediction, MoGIC uncovers latent human goals, leverages visual priors to enhance generation, and exhibits versatile multimodal generative capability. We further introduce a mixture-of-attention mechanism with adaptive scope to enable effective local alignment between conditional tokens and motion subsequences. To support this paradigm, we curate Mo440H, a 440-hour benchmark from 21 high-quality motion datasets. Experiments show that after finetuning, MoGIC reduces FID by 38.6% on HumanML3D and 34.6% on Mo440H, surpasses LLM-based methods in motion captioning with a lightweight text head, and further enables intention prediction and vision-conditioned generation, advancing controllable motion synthesis and intention understanding. The code is available at https://github.com/JunyuShi02/MoGIC

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 55 of its 59 references that are in the map. First posted on arXiv 3 Oct 2025.

Builds on

55 of 59 references.

References · 55

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  4. 2022Human Motion Diffusion Modelcited by 1,062
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  6. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  9. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  10. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
  11. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  12. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
38 more
  1. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  2. 2023Human Motion Diffusion as a Generative Priorcited by 354
  3. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  4. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  5. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  6. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  7. 2021Robust Motion In-betweeningcited by 223
  8. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
  9. 2023Object Motion Guided Human Motion Synthesiscited by 206
  10. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  11. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  12. 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
  13. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
  14. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  15. 2023MMM: Generative Masked Motion Modelcited by 129
  16. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  17. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
  18. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 111
  19. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
  20. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
  21. 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 101
  22. 20233D Human Pose Estimation via Intuitive Physicscited by 100
  23. 2023EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generationcited by 88
  24. 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
  25. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  26. 2022Full-Body Articulated Human-Object Interactioncited by 76
  27. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  28. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 58
  29. 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
  30. 2024BAMM: Bidirectional Autoregressive Motion Modelcited by 54
  31. 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
  32. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  33. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  34. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 46
  35. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motioncited by 46
  36. 2023I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactionscited by 42
  37. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
  38. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.