mlsanityData to 14 Oct 2026

Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations

arXiv 2608.01628 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video motion transfer aims to animate a target object using dynamics from a reference video. Existing formulations largely rely on fixed structural correspondence, which becomes ill-defined when reference and target objects differ substantially in morphology, articulation, or deformation mechanisms. We introduce Motion Beyond Morphology, a perspective that seeks to transfer motion beyond fixed structural correspondence, by preserving dynamics that remain meaningful across different target morphologies. To realize this, we propose a two-stage framework. Stage~I learns complementary multi-granularity abstract motion views and uses them to bootstrap cross-category video pairs that preserve transferable dynamics across diverse morphologies. Stage~II internalizes this supervision into direct reference-video-conditioned generation, removing the need for explicit motion extraction at inference. We further introduce OpenVMT-Dataset and OpenVMT-Bench for training and evaluating image- and text-conditioned motion transfer across Same, Near, and Far category gaps. Extensive experiments demonstrate state-of-the-art motion fidelity and target preservation. Project page: https://miniz233.github.io/MotionBeyondMorphology/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

24 of 30 references.

References · 24

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  4. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  5. 2023CoTracker: It is Better to Track Togethercited by 522
  6. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  7. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  8. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  9. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  10. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  12. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
12 more
  1. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  2. 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
  3. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 45
  4. 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
  5. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  6. 2024MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidancecited by 14
  7. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfercited by 14
  8. 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
  9. 2025DisMo: Disentangled Motion Representations for Open-World Motion Transfercited by 10
  10. 20263D-Aware Implicit Motion Control for View-Adaptive Human Video Generationcited by 6
  11. 2026TAPNext++: What's Next for Tracking Any Point (TAP)?cited by 6
  12. 2026FlowMotion: Training-Free Flow Guidance for Video Motion Transfercited by 1

Built on by

Not cited yet.