mlsanityData to 14 Oct 2026

Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning

arXiv 2605.30969 ↗First posted 29 May 2026cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Text-based human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the consistency of the original motion. Existing diffusion-based approaches often rely on heuristic similarity cues or coarse global conditioning, leading to motion distortion and suboptimal semantic alignment. The key challenge lies in balancing change (i.e. precisely editing target regions) and invariance (i.e. preserving unedited parts). To handle such challenge, we propose an Omni-Supervised Positive-Negative Learning framework, named OmniME. Our method integrates three complementary components: (1) retrospective feature supervision that enforces coarse-to-fine consistency across transformer layers,(2) motion preservation mechanism that focuses on subtle variations according to the source-target similarity, and (3) triplet-based semantic alignment that strengthens text-motion correspondence. Together, these components form a unified supervision paradigm that balances change and invariance. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment, validating the effectiveness of our unified learning framework. Our source codes and models have been released at: https://github.com/rocket-ycyer/OmniME.git

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

67 of 82 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2016Improved Techniques for Training GANscited by 2,970
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  10. 2022Human Motion Diffusion Modelcited by 1,080
  11. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  12. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
38 more
  1. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  2. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  3. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  4. 2023Human Motion Diffusion as a Generative Priorcited by 357
  5. 2022EDGE: Editable Dance Generation From Musiccited by 287
  6. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
  7. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
  8. 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 254
  9. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  10. 2021Robust Motion In-betweeningcited by 229
  11. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  12. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  13. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  14. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  15. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  16. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  17. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  18. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
  19. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  20. 2023MMM: Generative Masked Motion Modelcited by 131
  21. 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
  22. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
  23. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
  24. 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
  25. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  26. 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
  27. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
  28. 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
  29. 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
  30. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  31. 2021Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learningcited by 58
  32. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
  33. 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
  34. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
  35. 2018Human Motion Modeling using DVGANscited by 45
  36. 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 45
  37. 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 40
  38. 2023Iterative Motion Editing with Natural Languagecited by 40

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.