Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning
Not on the map. Why?
Abstract (arXiv)
Text-based human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the consistency of the original motion. Existing diffusion-based approaches often rely on heuristic similarity cues or coarse global conditioning, leading to motion distortion and suboptimal semantic alignment. The key challenge lies in balancing change (i.e. precisely editing target regions) and invariance (i.e. preserving unedited parts). To handle such challenge, we propose an Omni-Supervised Positive-Negative Learning framework, named OmniME. Our method integrates three complementary components: (1) retrospective feature supervision that enforces coarse-to-fine consistency across transformer layers,(2) motion preservation mechanism that focuses on subtle variations according to the source-target similarity, and (3) triplet-based semantic alignment that strengthens text-motion correspondence. Together, these components form a unified supervision paradigm that balances change and invariance. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment, validating the effectiveness of our unified learning framework. Our source codes and models have been released at: https://github.com/rocket-ycyer/OmniME.git
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
67 of 82 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016Improved Techniques for Training GANscited by 2,970
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2022Human Motion Diffusion Modelcited by 1,080
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
38 more
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 287
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 254
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2021Robust Motion In-betweeningcited by 229
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
- 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 168
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
- 2023MMM: Generative Masked Motion Modelcited by 131
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 117
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
- 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
- 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editingcited by 67
- 2023SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generationcited by 64
- 2024MotionFix: Text-Driven 3D Human Motion Editingcited by 64
- 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
- 2021Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learningcited by 58
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2023OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllerscited by 47
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 46
- 2018Human Motion Modeling using DVGANscited by 45
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 45
- 2023PoseFix: Correcting 3D Human Poses with Natural Languagecited by 40
- 2023Iterative Motion Editing with Natural Languagecited by 40
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
- 2026MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfercited by 0
- 2026UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generationcited by 0
- 2026SuperMotion: Source-Preserving Denoising for Text-Driven Human Motion Editingcited by 0
- 2026TAME:Topology-Aware Text-Driven Motion Editing across Heterogeneous Humanoid Skeletonscited by 0
- 2026TAME:Topology-Aware Text-Driven Motion Editing across Heterogeneous Humanoid Skeletons3 Oct 2026
- 2026SuperMotion: Source-Preserving Denoising for Text-Driven Human Motion Editing1 Oct 2026
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation10 Aug 2026
- 2026MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfer28 Jul 2026