mlsanityData to 7 Oct 2026

Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing

arXiv 2608.16008 ↗First posted 17 Aug 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 78 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

64 of 78 references.

References · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2016Improved Techniques for Training GANscited by 2,938
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  11. 2022Human Motion Diffusion Modelcited by 1,062
  12. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
38 more
  1. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  2. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  3. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  4. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  5. 2023Human Motion Diffusion as a Generative Priorcited by 354
  6. 2022EDGE: Editable Dance Generation From Musiccited by 284
  7. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  8. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  9. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  10. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
  11. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  12. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  13. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  14. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 194
  15. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  16. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  17. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  18. 2023MMM: Generative Masked Motion Modelcited by 129
  19. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 118
  20. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  21. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 105
  22. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 89
  23. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  24. 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
  25. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 66
  26. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 63
  27. 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 62
  28. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 52
  29. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  30. 2018Human Motion Modeling using DVGANscited by 45
  31. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
  32. 2023Iterative Motion Editing with Natural Languagecited by 39
  33. 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 38
  34. 20223D Human Motion Prediction: A Surveycited by 30
  35. 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 30
  36. 2024TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generationcited by 27
  37. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
  38. 2023InsActor: Instruction-driven Physics-based Characterscited by 23

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.