mlsanityData to 7 Oct 2026

A Self-Supervised Approach on Motion Calibration for Enhancing Physical Plausibility in Text-to-Motion

arXiv 2602.18199 ↗First posted 20 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating semantically aligned human motion from textual descriptions has made rapid progress, but ensuring both semantic and physical realism in motion remains a challenge. In this paper, we introduce the Distortion-aware Motion Calibrator (DMC), a post-hoc module that refines physically implausible motions (e.g., foot floating) while preserving semantic consistency with the original textual description. Rather than relying on complex physical modeling, we propose a self-supervised and data-driven approach, whereby DMC learns to obtain physically plausible motions when an intentionally distorted motion and the original textual descriptions are given as inputs. We evaluate DMC as a post-hoc module to improve motions obtained from various text-to-motion generation models and demonstrate its effectiveness in improving physical plausibility while enhancing semantic consistency. The experimental results show that DMC reduces FID score by 42.74% on T2M and 13.20% on T2M-GPT, while also achieving the highest R-Precision. When applied to high-quality models like MoMask, DMC improves the physical plausibility of motions by reducing penetration by 33.0% as well as adjusting floating artifacts closer to the ground-truth reference. These results highlight that DMC can serve as a promising post-hoc motion refinement framework for any kind of text-to-motion models by incorporating textual semantics and physical plausibility.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

35 of 47 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2017Improved Training of Wasserstein GANscited by 2,223
  5. 2022Human Motion Diffusion Modelcited by 1,062
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  8. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  9. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  10. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  11. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  12. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
23 more
  1. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  2. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  3. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  4. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  5. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  6. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  7. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
  8. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  9. 2017Learning human behaviors from motion capture by adversarial imitationcited by 75
  10. 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
  11. 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generationcited by 56
  12. 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
  13. 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 50
  14. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
  15. 2022MotionMixer: MLP-based 3D Human Body Pose Forecastingcited by 42
  16. 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 30
  17. 2021Skeletor: Skeletal Transformers for Robust Body-Pose Estimationcited by 26
  18. 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
  19. 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptionscited by 22
  20. 2022Learning Variational Motion Prior for Video-based Motion Capturecited by 17
  21. 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 16
  22. 2023ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Spacecited by 11
  23. 2025FlexMotion: Lightweight, Physics-Aware, and Controllable Human Motion Generationcited by 7

Built on by

Not cited yet.