mlsanityData to 14 Oct 2026

Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Control

arXiv 2508.08134 ↗First posted 11 Aug 2025cs.CVcited by 28

Not on the map. Why?

Abstract (arXiv)

While recent flow-based image editing models demonstrate general-purpose capabilities across diverse tasks, they often struggle to specialize in challenging scenarios -- particularly those involving large-scale shape transformations. When performing such structural edits, these methods either fail to achieve the intended shape change or inadvertently alter non-target regions, resulting in degraded background quality. We propose Follow-Your-Shape, a training-free and mask-free framework that supports precise and controllable editing of object shapes while strictly preserving non-target content. Motivated by the divergence between inversion and editing trajectories, we compute a Trajectory Divergence Map (TDM) by comparing token-wise velocity differences between the inversion and denoising paths. The TDM enables precise localization of editable regions and guides a Scheduled KV Injection mechanism that ensures stable and faithful editing. To facilitate a rigorous evaluation, we introduce ReShapeBench, a new benchmark comprising 120 new images and enriched prompt pairs specifically curated for shape-aware editing. Experiments demonstrate that our method achieves superior editability and visual fidelity, particularly in tasks requiring large-scale shape replacement.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 69 of its 101 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

69 of 101 references.

References · 69

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2023Segment Anythingcited by 8,234
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Flow Matching for Generative Modelingcited by 5,702
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
38 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  2. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  4. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  5. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  6. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  7. 2022Efficiently Scaling Transformer Inferencecited by 539
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  9. 2022Blended Latent Diffusioncited by 432
  10. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  11. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  12. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  13. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  14. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  15. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  16. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  17. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  18. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  19. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  20. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  21. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  22. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  23. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  24. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  25. 2025Controllable Video Generation: A Surveycited by 98
  26. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  27. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
  28. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  29. 2024Dynamic Diffusion Transformercited by 62
  30. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  31. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  32. 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 58
  33. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
  34. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
  35. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  36. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  37. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  38. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 21.

28 papers.

Sort:

By area:

  1. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
  2. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  3. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  4. 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
  5. 2026Group Editing: Edit Multiple Images in One Gocited by 11
  6. 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
  7. 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 7
  8. 2025SpotEdit: Selective Region Editing in Diffusion Transformerscited by 7
  9. 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
  10. 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanationcited by 5
  11. 2026Embedding-perturbed Exploration Preference Optimization for Flow Modelscited by 5
  12. 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editingcited by 4
16 more
  1. 2026Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generationcited by 4
  2. 2026Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interactioncited by 3
  3. 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
  4. 2026EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generationcited by 2
  5. 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
  6. 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
  7. 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
  8. 2026Uni-Animator: Towards Unified Visual Colorizationcited by 0
  9. 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
  10. 2026When to Lock Attention: Training-Free KV Control in Video Diffusioncited by 0
  11. 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editingcited by 0
  12. 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
  13. 2026SR-Edit: Region-Aware Image Editing via Self-Refinementcited by 0
  14. 2026Multi-History-Step SDE Inversion for Image Editing with Superior Regional Awarenesscited by 0
  15. 2026Constrained Edit Fields for Training-Free Flow Editingcited by 0
  16. 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Trainingcited by 0