Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Control
Not on the map. Why?
Abstract (arXiv)
While recent flow-based image editing models demonstrate general-purpose capabilities across diverse tasks, they often struggle to specialize in challenging scenarios -- particularly those involving large-scale shape transformations. When performing such structural edits, these methods either fail to achieve the intended shape change or inadvertently alter non-target regions, resulting in degraded background quality. We propose Follow-Your-Shape, a training-free and mask-free framework that supports precise and controllable editing of object shapes while strictly preserving non-target content. Motivated by the divergence between inversion and editing trajectories, we compute a Trajectory Divergence Map (TDM) by comparing token-wise velocity differences between the inversion and denoising paths. The TDM enables precise localization of editable regions and guides a Scheduled KV Injection mechanism that ensures stable and faithful editing. To facilitate a rigorous evaluation, we introduce ReShapeBench, a new benchmark comprising 120 new images and enriched prompt pairs specifically curated for shape-aware editing. Experiments demonstrate that our method achieves superior editability and visual fidelity, particularly in tasks requiring large-scale shape replacement.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 69 of its 101 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
69 of 101 references.
References · 69
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023Segment Anythingcited by 8,234
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
38 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Efficiently Scaling Transformer Inferencecited by 539
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2022Blended Latent Diffusioncited by 432
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2024Dynamic Diffusion Transformercited by 62
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 58
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2025: 7; 2026: 21.
28 papers.
Sort:
By area:
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
- 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 7
- 2025SpotEdit: Selective Region Editing in Diffusion Transformerscited by 7
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Modelscited by 5
- 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editingcited by 4
16 more
- 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generationcited by 4
- 2026Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interactioncited by 3
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
- 2026EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generationcited by 2
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2026Uni-Animator: Towards Unified Visual Colorizationcited by 0
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
- 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editingcited by 0
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
- 2026SR-Edit: Region-Aware Image Editing via Self-Refinementcited by 0
- 2026Multi-History-Step SDE Inversion for Image Editing with Superior Regional Awarenesscited by 0
- 2026Constrained Edit Fields for Training-Free Flow Editingcited by 0
- 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Trainingcited by 0
- 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training4 Oct 2026
- 2026Constrained Edit Fields for Training-Free Flow Editing27 Sep 2026
- 2026Multi-History-Step SDE Inversion for Image Editing with Superior Regional Awareness6 Sep 2026
- 2026SR-Edit: Region-Aware Image Editing via Self-Refinement2 Sep 2026
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editing7 Aug 2026
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Control3 Aug 2026
- 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing23 Jul 2026
- 2026EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generation21 May 2026
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Models15 May 2026
- 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generation12 Apr 2026
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorization26 Mar 2026
16 more
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interaction23 Mar 2026
- 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing16 Mar 2026
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusion10 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026Uni-Animator: Towards Unified Visual Colorization26 Feb 2026
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agents17 Feb 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2025SpotEdit: Selective Region Editing in Diffusion Transformers26 Dec 2025
- 2025VideoCoF: Unified Video Editing with Temporal Reasoner8 Dec 2025
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation18 Nov 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generation1 Oct 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep 2025
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animation20 Sep 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2025SpotEdit: Selective Region Editing in Diffusion Transformerscited by 7
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
- 2026Uni-Animator: Towards Unified Visual Colorizationcited by 0
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
- 2026Constrained Edit Fields for Training-Free Flow Editingcited by 0
- 2026Constrained Edit Fields for Training-Free Flow Editing27 Sep 2026
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorization26 Mar 2026
- 2026When to Lock Attention: Training-Free KV Control in Video Diffusion10 Mar 2026
- 2026Uni-Animator: Towards Unified Visual Colorization26 Feb 2026
- 2025SpotEdit: Selective Region Editing in Diffusion Transformers26 Dec 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep 2025
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 7
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
- 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generationcited by 4
- 2026Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interactioncited by 3
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
- 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editingcited by 0
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training4 Oct 2026
- 2026Multi-History-Step SDE Inversion for Image Editing with Superior Regional Awareness6 Sep 2026
- 2026SR-Edit: Region-Aware Image Editing via Self-Refinement2 Sep 2026
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editing7 Aug 2026
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Control3 Aug 2026
- 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing23 Jul 2026
- 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generation12 Apr 2026
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2026Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interaction23 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
12 newest of 15 All 15 (JSON)