mlsanityData to 14 Oct 2026

UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation

arXiv 2608.09143 ↗First posted 10 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Instruction-driven editing of 3D human motion requires precise spatiotemporal localization, rich semantic grounding, and strict preservation of unmodified content. Existing methods either resort to training-free adaptation of generative models or rely solely on triplet supervision; however, adaptation often yields suboptimal control, and manually curated triplet datasets remain severely limited in scale and semantic diversity. To overcome this bottleneck, we ground motion editing directly within text-to-motion generation across data, architecture, and inference. At the data level, we develop a closed-loop synthesis-and-verification pipeline that produces Omni-MoEdit, a large-scale dataset spanning body-part, amplitude, temporal, action, and style edits. At the architectural level, we introduce UniMoFlow, a unified latent flow-matching model that shares broad semantic and kinematic knowledge between generation and editing. At the inference level, SAFE (Source-Anchored Flow Editing) complements UniMoFlow with controllable, source-anchored refinement. Furthermore, we augment standard evaluations with semantics-aware metrics to account for valid edits that inherently deviate from a single ground-truth reference. Extensive experiments demonstrate improved target-text alignment, edit effectiveness, and cycle consistency, while maintaining competitive source fidelity and text-to-motion generation quality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

23 of 29 references.

References · 23

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  4. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  5. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  6. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  8. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  9. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  10. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  11. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  12. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
11 more
  1. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  2. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 50
  3. 2025SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editingcited by 39
  4. 2024DreamOmni: Unified Image Generation and Editingcited by 30
  5. 2025MotionLab: Unified Human Motion Generation and Editing via the Motion-Condition-Motion Paradigmcited by 30
  6. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
  7. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
  8. 2025Dynamic Motion Blending for Versatile Motion Editingcited by 15
  9. 2025PartMotionEdit: Fine-Grained Text-Driven 3D Human Motion Editing via Part-Level Modulationcited by 5
  10. 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 5
  11. 2026A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargetingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024MotionFix: Text-Driven 3D Human Motion Editing
  2. 2023Motion Flow Matching for Human Motion Synthesis and Editing
  3. 2024CoMo: Controllable Motion Generation through Language Guided Pose Code Editing
  4. 2026InterEdit: Navigating Text-Guided 3D Dyadic Human Motion Editing
  5. 2026MotionHiFlow: Text-to-motion via hierarchical flow matching
  6. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation
  7. 2023MMM: Generative Masked Motion Model
  8. 2026MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation