mlsanityData to 14 Oct 2026

X-MoGen: Unified Motion Generation across Humans and Animals

arXiv 2508.05162 ↗First posted 7 Aug 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Text-driven motion generation has attracted increasing attention due to its broad applications in virtual reality, animation, and robotics. While existing methods typically model human and animal motion separately, a joint cross-species approach offers key advantages, such as a unified representation and improved generalization. However, morphological differences across species remain a key challenge, often compromising motion plausibility. To address this, we propose X-MoGen, the first unified framework for cross-species text-driven motion generation covering both humans and animals. X-MoGen adopts a two-stage architecture. First, a conditional graph variational autoencoder learns canonical T-pose priors, while an autoencoder encodes motion into a shared latent space regularized by morphological loss. In the second stage, we perform masked motion modeling to generate motion embeddings conditioned on textual descriptions. During training, a morphological consistency module is employed to promote skeletal plausibility across species. To support unified modeling, we construct UniMo4D, a large-scale dataset of 115 species and 119k motion sequences, which integrates human and animal motions under a shared skeletal topology for joint training. Extensive experiments on UniMo4D demonstrate that X-MoGen outperforms state-of-the-art methods on both seen and unseen species.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 63 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

47 of 63 references.

References · 47

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2013Auto-Encoding Variational Bayescited by 4,053
  7. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  9. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  10. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  11. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
35 more
  1. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  2. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  3. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  4. 2016The KIT Motion-Language Datasetcited by 338
  5. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  6. 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 227
  7. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  8. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  9. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  10. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  11. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
  12. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  13. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  14. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  15. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  16. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  17. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  18. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
  19. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  20. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
  21. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 50
  22. 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
  23. 2025Motion Anything: Any to Motion Generationcited by 42
  24. 2025AnyTop: Character Animation Diffusion with Any Topologycited by 41
  25. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
  26. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  27. 2025MG-MotionLLM: A Unified Framework for Motion Comprehension and Generation across Multiple Granularitiescited by 30
  28. 2025Absolute Coordinates Make Motion Generation Easycited by 29
  29. 2023OmniMotionGPT: Animal Motion Generation with Limited Datacited by 20
  30. 2024Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motioncited by 19
  31. 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 17
  32. 2024WalkTheDog: Cross-Morphology Motion Alignment via Phase Manifoldscited by 14
  33. 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motionscited by 11
  34. 2025StickMotion: Generating 3D Human Motions by Drawing a Stickmancited by 9
  35. 2025Deterministic-to-Stochastic Diverse Latent Feature Mapping for Human Motion Synthesiscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.