mlsanityData to 7 Oct 2026

Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion

arXiv 2606.21135 ↗First posted 19 Jun 2026cs.CV cs.GR cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Human motion generation has been widely studied across diverse input modalities, text, music, and video, and recent efforts have unified these into single multimodal frameworks. However, while morphological factors such as gender and body shape are known to produce distinct kinematic signatures, no existing unified framework incorporates this into generation, treating all subjects as morphologically equivalent. We present Odoriko, the first unified multimodal motion generation framework that reflects subject bio-morphological information directly in synthesized motion output. Rather than averaging over subject variation, Odoriko generates motion that is consistent with who is moving, not just what they are asked to do, across text, music, and video conditions within a single model. When explicit morphological information is unavailable, Odoriko additionally recovers subject morphology alongside motion, unifying estimation and generation in one framework. Extensive experiments across text-to-motion, music-to-dance, and video-to-motion benchmarks demonstrate that Odoriko matches or exceeds prior specialized models on standard metrics, while enabling morphology-consistent generation that no existing unified framework supports.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 77 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

61 of 77 references.

References · 61

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  12. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
38 more
  1. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  2. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  3. 2022Human Motion Diffusion Modelcited by 1,062
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  6. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  7. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  8. 2020Jukebox: A Generative Model for Musiccited by 535
  9. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  10. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  11. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  12. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  13. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  14. 2022EDGE: Editable Dance Generation From Musiccited by 284
  15. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  16. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  17. 2023Object Motion Guided Human Motion Synthesiscited by 206
  18. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  19. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  20. 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
  21. 2023MMM: Generative Masked Motion Modelcited by 129
  22. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
  23. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  24. 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
  25. 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
  26. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  27. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  28. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 78
  29. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  30. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  31. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 59
  32. 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 49
  33. 2025GENMO: A GENeralist Model for Human MOtioncited by 43
  34. 2024M3GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generationcited by 37
  35. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  36. 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 24
  37. 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
  38. 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.