mlsanityData to 14 Oct 2026

UniMo: Unified Motion Generation and Understanding with Chain of Thought

arXiv 2601.12126 ↗First posted 17 Jan 2026cs.AIcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Existing 3D human motion generation and understanding methods often exhibit limited interpretability, restricting effective mutual enhancement between these inherently related tasks. While current unified frameworks based on large language models (LLMs) leverage linguistic priors, they frequently encounter challenges in semantic alignment and task coherence. Moreover, the next-token prediction paradigm in LLMs is ill-suited for motion sequences, causing cumulative prediction errors. To address these limitations, we propose UniMo, a novel framework that integrates motion-language information and interpretable chain of thought (CoT) reasoning into the LLM via supervised fine-tuning (SFT). We further introduce reinforcement learning with Group Relative Policy Optimization (GRPO) as a post-training strategy that optimizes over groups of tokens to enforce structural correctness and semantic alignment, mitigating cumulative errors in motion token prediction. Extensive experiments demonstrate that UniMo significantly outperforms existing unified and task-specific models, achieving state-of-the-art performance in both motion generation and understanding.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 52 references that are in the map. First posted on arXiv 17 Jan 2026.

Builds on

23 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Motion-R1: Enhancing Motion Generation with Decomposed Chain-of-Thought and RL Binding12 Jun

Other references · 22

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  8. 2024Qwen2.5 Technical Reportcited by 4,942
  9. 2022Human Motion Diffusion Modelcited by 1,080
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  12. 2024Emu3: Next-Token Prediction is All You Needcited by 781
10 more
  1. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  2. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  3. 2025Transfer between Modalities with MetaQueriescited by 236
  4. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  5. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  6. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  7. 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 59
  8. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  9. 2024Motion-Agent: A Conversational Framework for Human Motion Generation with LLMscited by 47
  10. 2024MoTe: Learning Motion-Text Diffusion Model for Multiple Generation Taskscited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MoRL: Reinforced Reasoning for Unified Motion Understanding and Generation
  2. 2026MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation
  3. 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation
  4. 2026LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens
  5. 2026UniWAM: Unified World-Action Model
  6. 2026Re2MoGen: Open-Vocabulary Motion Generation via LLM Reasoning and Physics-Aware Refinement
  7. 2026LaMoGen: Language to Motion Generation Through LLM-Guided Symbolic Inference
  8. 2024Learning Generalizable Human Motion Generator with Reinforcement Learning