Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion
Not on the map. Why?
Abstract (arXiv)
Human motion generation has been widely studied across diverse input modalities, text, music, and video, and recent efforts have unified these into single multimodal frameworks. However, while morphological factors such as gender and body shape are known to produce distinct kinematic signatures, no existing unified framework incorporates this into generation, treating all subjects as morphologically equivalent. We present Odoriko, the first unified multimodal motion generation framework that reflects subject bio-morphological information directly in synthesized motion output. Rather than averaging over subject variation, Odoriko generates motion that is consistent with who is moving, not just what they are asked to do, across text, music, and video conditions within a single model. When explicit morphological information is unavailable, Odoriko additionally recovers subject morphology alongside motion, unifying estimation and generation in one framework. Extensive experiments across text-to-motion, music-to-dance, and video-to-motion benchmarks demonstrate that Odoriko matches or exceeds prior specialized models on standard metrics, while enabling morphology-consistent generation that no existing unified framework supports.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 77 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
61 of 77 references.
References · 61
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
38 more
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2022Human Motion Diffusion Modelcited by 1,062
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
- 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 59
- 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 49
- 2025GENMO: A GENeralist Model for Human MOtioncited by 43
- 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
- 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 24
- 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
- 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.