Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing
Not on the map. Why?
Abstract (arXiv)
Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 78 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
64 of 78 references.
References · 64
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016Improved Techniques for Training GANscited by 2,938
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
38 more
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023Human Motion Diffusion as a Generative Priorcited by 354
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
- 2023MMM: Generative Masked Motion Modelcited by 129
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 118
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
- 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
- 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 63
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 62
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 52
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2018Human Motion Modeling using DVGANscited by 45
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
- 2023Iterative Motion Editing with Natural Languagecited by 39
- 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 38
- 20223D Human Motion Prediction: A Surveycited by 30
- 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 30
- 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
- 2023InsActor: Instruction-driven Physics-based Characterscited by 23
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.