Search2Motion: Training-Free Object-Level Motion Control via Attention-Consensus Search
Not on the map. Why?
Abstract (arXiv)
We present Search2Motion, a training-free framework for object-level motion editing in image-to-video generation. Unlike prior methods requiring trajectories, bounding boxes, masks, or motion fields, Search2Motion adopts target-frame-based control, leveraging first-last-frame motion priors to realize object relocation while preserving scene stability without fine-tuning. Reliable target-frame construction is achieved through semantic-guided object insertion and robust background inpainting. We further show that early-step self-attention maps predict object and camera dynamics, offering interpretable user feedback and motivating ACE-Seed (Attention Consensus for Early-step Seed selection), a lightweight search strategy that improves motion fidelity without look-ahead sampling or external evaluators. Noting that existing benchmarks conflate object and camera motion, we introduce S2M-DAVIS and S2M-OMB for stable-camera, object-only evaluation, alongside FLF2V-obj metrics that isolate object artifacts without requiring ground-truth trajectories. Search2Motion consistently outperforms baselines on FLF2V-obj and VBench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
28 of 35 references.
References · 28
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2025VACE: All-in-One Video Creation and Editingcited by 479
16 more
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2025Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Searchcited by 41
- 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
- 2025ObjectMover: Generative Object Movement with Video Priorcited by 30
- 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
- 2025Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generationcited by 20
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoisingcited by 13
- 2025ScalingNoise: Scaling Inference-Time Search for Generating Infinite Videoscited by 12
- 2025Model Already Knows the Best Noise: Bayesian Active Noise Selection via Attention in Video Diffusion Modelcited by 10
Built on by
Not cited yet.