A Self-Supervised Approach on Motion Calibration for Enhancing Physical Plausibility in Text-to-Motion
Not on the map. Why?
Abstract (arXiv)
Generating semantically aligned human motion from textual descriptions has made rapid progress, but ensuring both semantic and physical realism in motion remains a challenge. In this paper, we introduce the Distortion-aware Motion Calibrator (DMC), a post-hoc module that refines physically implausible motions (e.g., foot floating) while preserving semantic consistency with the original textual description. Rather than relying on complex physical modeling, we propose a self-supervised and data-driven approach, whereby DMC learns to obtain physically plausible motions when an intentionally distorted motion and the original textual descriptions are given as inputs. We evaluate DMC as a post-hoc module to improve motions obtained from various text-to-motion generation models and demonstrate its effectiveness in improving physical plausibility while enhancing semantic consistency. The experimental results show that DMC reduces FID score by 42.74% on T2M and 13.20% on T2M-GPT, while also achieving the highest R-Precision. When applied to high-quality models like MoMask, DMC improves the physical plausibility of motions by reducing penetration by 33.0% as well as adjusting floating artifacts closer to the ground-truth reference. These results highlight that DMC can serve as a promising post-hoc motion refinement framework for any kind of text-to-motion models by incorporating textual semantics and physical plausibility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
35 of 47 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
23 more
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
- 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
- 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 80
- 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
- 2017Learning human behaviors from motion capture by adversarial imitationcited by 75
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generationcited by 56
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
- 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 50
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
- 2022MotionMixer: MLP-based 3D Human Body Pose Forecastingcited by 42
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 30
- 2021Skeletor: Skeletal Transformers for Robust Body-Pose Estimationcited by 26
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
- 2024Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptionscited by 22
- 2022Learning Variational Motion Prior for Video-based Motion Capturecited by 17
- 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 16
- 2023ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Spacecited by 11
- 2025FlexMotion: Lightweight, Physics-Aware, and Controllable Human Motion Generationcited by 7
Built on by
Not cited yet.