RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers
On the map: Diffusion models → Video generation
Abstract (arXiv)
We propose RoPECraft, a training-free video motion transfer method for diffusion transformers that operates solely by modifying their rotary positional embeddings (RoPE). We first extract dense optical flow from a reference video, and utilize the resulting motion offsets to warp the complex-exponential tensors of RoPE, effectively encoding motion into the generation process. These embeddings are then further optimized during denoising time steps via trajectory alignment between the predicted and target velocities using a flow-matching objective. To keep the output faithful to the text prompt and prevent duplicate generations, we incorporate a regularization term based on the phase components of the reference video's Fourier transform, projecting the phase angles onto a smooth manifold to suppress high-frequency artifacts. Experiments on benchmarks reveal that RoPECraft outperforms all recently published methods, both qualitatively and quantitatively.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 48 of its 51 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
48 of 51 references.
Closest ancestors · 14
Same direction, newest first
- 2025FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise5 Feb
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
- 2024Video Motion Transfer with Diffusion Transformers10 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
- 2024Video Diffusion Models are Training-free Motion Interpreter and Controller23 May
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023ModelScope Text-to-Video Technical Report12 Aug
2 more
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
22 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2021Conditional Positional Encodings for Vision Transformerscited by 406
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2024Rotary Position Embedding for Vision Transformercited by 236
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2024Round and Round We Go! What makes Rotary Positional Encodings useful?cited by 115
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2024ViTAR: Vision Transformer with Any Resolutioncited by 25
- 2025VRoPE: Rotary Position Embedding for Video Large Language Modelscited by 18
- 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 14
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
- 2024Reenact Anything: Semantic Video Motion Transfer Using Motion-Textual Inversioncited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 12.
14 papers.
Sort:
By area:
- 2026ActionParty: Multi-Subject Action Binding in Generative Video Gamescited by 5
- 2025LAMP: Language-Assisted Motion Planning for Controllable Video Generationcited by 4
- 2026SafeRoPE: Risk-specific Head-wise Embedding Rotation for Safe Generation in Rectified Flow Transformerscited by 2
- 2025PosBridge: Multi-View Positional Embedding Transplant for Identity-Aware Image Editingcited by 1
- 2026Video Analysis and Generation via a Semantic Progress Functioncited by 1
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generationcited by 1
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 1
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customizationcited by 0
- 2026BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editingcited by 0
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editingcited by 0
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddingscited by 0
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformerscited by 0
2 more
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Heads13 Jul 2026
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers2 Jul 2026
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddings25 Jun 2026
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation10 Jun 2026
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation1 Jun 2026
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing14 May 2026
- 2026BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editing8 May 2026
- 2026Video Analysis and Generation via a Semantic Progress Function24 Apr 2026
- 2026ActionParty: Multi-Subject Action Binding in Generative Video Games2 Apr 2026
- 2026SafeRoPE: Risk-specific Head-wise Embedding Rotation for Safe Generation in Rectified Flow Transformers2 Apr 2026
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization5 Jan 2026
- 2026SafeRoPE: Risk-specific Head-wise Embedding Rotation for Safe Generation in Rectified Flow Transformerscited by 2
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 1
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customizationcited by 0
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformerscited by 0
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Headscited by 0
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Heads13 Jul 2026
- 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers2 Jul 2026
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation10 Jun 2026
- 2026SafeRoPE: Risk-specific Head-wise Embedding Rotation for Safe Generation in Rectified Flow Transformers2 Apr 2026
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization5 Jan 2026
- 2025LAMP: Language-Assisted Motion Planning for Controllable Video Generationcited by 4
- 2025PosBridge: Multi-View Positional Embedding Transplant for Identity-Aware Image Editingcited by 1
- 2026Video Analysis and Generation via a Semantic Progress Functioncited by 1
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generationcited by 1
- 2026BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editingcited by 0
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editingcited by 0
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddingscited by 0
- 2026Motion4Motion: Motion Transfer Across Subjects at Inferencecited by 0
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026RoPEMover: Depth-Aware Object Relocation via Positional Embeddings25 Jun 2026
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation1 Jun 2026
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing14 May 2026
- 2026BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editing8 May 2026
- 2026Video Analysis and Generation via a Semantic Progress Function24 Apr 2026
- 2025LAMP: Language-Assisted Motion Planning for Controllable Video Generation3 Dec 2025
- 2025PosBridge: Multi-View Positional Embedding Transplant for Identity-Aware Image Editing24 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026RoPeSLR: 3D RoPE-driven Sparse-LowRank Attention for Efficient Diffusion Transformers
- 2026AcrossVAM2.0: Conflict-Aware Point Supervision for Parameter-Efficient Video Diffusion Adaptation
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning
- 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modification
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code
- 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
- 2026ViFeEdit: A Video-Free Tuner of Your Video Diffusion Transformer