X-MoGen: Unified Motion Generation across Humans and Animals
Not on the map. Why?
Abstract (arXiv)
Text-driven motion generation has attracted increasing attention due to its broad applications in virtual reality, animation, and robotics. While existing methods typically model human and animal motion separately, a joint cross-species approach offers key advantages, such as a unified representation and improved generalization. However, morphological differences across species remain a key challenge, often compromising motion plausibility. To address this, we propose X-MoGen, the first unified framework for cross-species text-driven motion generation covering both humans and animals. X-MoGen adopts a two-stage architecture. First, a conditional graph variational autoencoder learns canonical T-pose priors, while an autoencoder encodes motion into a shared latent space regularized by morphological loss. In the second stage, we perform masked motion modeling to generate motion embeddings conditioned on textual descriptions. During training, a morphological consistency module is employed to promote skeletal plausibility across species. To support unified modeling, we construct UniMo4D, a large-scale dataset of 115 species and 119k motion sequences, which integrates human and animal motions under a shared skeletal topology for joint training. Extensive experiments on UniMo4D demonstrate that X-MoGen outperforms state-of-the-art methods on both seen and unseen species.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 63 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
47 of 63 references.
References · 47
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
35 more
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2016The KIT Motion-Language Datasetcited by 338
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 227
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
- 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
- 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 53
- 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 50
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
- 2025Motion Anything: Any to Motion Generationcited by 42
- 2025AnyTop: Character Animation Diffusion with Any Topologycited by 41
- 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
- 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
- 2025MG-MotionLLM: A Unified Framework for Motion Comprehension and Generation across Multiple Granularitiescited by 30
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2023OmniMotionGPT: Animal Motion Generation with Limited Datacited by 20
- 2024Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motioncited by 19
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 17
- 2024WalkTheDog: Cross-Morphology Motion Alignment via Phase Manifoldscited by 14
- 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motionscited by 11
- 2025StickMotion: Generating 3D Human Motions by Drawing a Stickmancited by 9
- 2025Deterministic-to-Stochastic Diverse Latent Feature Mapping for Human Motion Synthesiscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectoriescited by 1
- 2026Neural-Behavioral Representation of Natural Whole-body Movement in Monkeyscited by 0
- 2026Two2Four: Generative Quadruped Puppeteering from Human Motioncited by 0
- 2026TAME:Topology-Aware Text-Driven Motion Editing across Heterogeneous Humanoid Skeletonscited by 0
- 2026TAME:Topology-Aware Text-Driven Motion Editing across Heterogeneous Humanoid Skeletons3 Oct 2026
- 2026Two2Four: Generative Quadruped Puppeteering from Human Motion28 Jul 2026
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories24 Jun 2026
- 2026Neural-Behavioral Representation of Natural Whole-body Movement in Monkeys28 May 2026