EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing
Not on the map. Why?
Abstract (arXiv)
Visual-prompt-guided edit transfer aims to learn image transformations directly from example pairs, offering more precise and controllable editing than purely text-driven approaches. However, existing diffusion transformer-based methods often fail to faithfully reproduce the demonstrated edits due to structural mismatches between the task and the backbone, including a pretrained bias toward textual conditioning and inherent stochastic instability during sampling. To bridge this gap, we present EditTransfer++, a framework that combines progressively structured training with an efficient conditioning scheme to improve both visual prompt faithfulness and inference efficiency. We first mitigate textual dominance with a text-decoupled training strategy that removes text conditioning during fine-tuning, compelling the model to infer transformations solely from visual evidence while still supporting optional text guidance at inference. On top of this visually grounded model, a best-worst contrastive refinement mechanism reshapes the denoising trajectories to suppress unfaithful generations and improve consistency across random seeds. To alleviate the computational bottleneck of high-resolution in-context editing, we further introduce a condition compression and reuse strategy that reduces token redundancy and enables efficient generation of images with a 1024-pixel long edge. Extensive experiments on existing benchmarks and the proposed EditTransfer-Bench show that EditTransfer++ achieves state-of-the-art visual prompt faithfulness with substantially faster inference than prior methods, suggesting a promising direction for scalable prompt-guided image editing and broader visual in-context learning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 56 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
48 of 56 references.
References · 48
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024GPT-4o System Cardcited by 4,588
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
36 more
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
- 2022Visual Prompting via Image Inpaintingcited by 250
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 135
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2024Zero-shot Image Editing with Reference Imitationcited by 65
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 45
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 36
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 33
- 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
- 2023Unifying Image Processing as Visual Prompting Question Answeringcited by 29
- 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformerscited by 26
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
- 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
- 2025Personalized Vision via Visual In-Context Learningcited by 14
- 2025Consistent Image Layout Editing with Diffusion Modelscited by 9
- 2023POCE: Pose-Controllable Expression Editingcited by 8
- 2025PairEdit: Learning Semantic Variations for Exemplar-based Image Editingcited by 8
- 2021ReGO: Reference-Guided Outpainting for Scenery Imagecited by 6
- 2025PIXELS: Progressive Image Xemplar-based Editing with Latent Surgerycited by 5
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Language-Free Generative Editing from One Visual Example
- 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
- 2023Visual Instruction Inversion: Image Editing via Visual Prompting
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
- 2024Diffusion-Based Conditional Image Editing through Optimized Inference with Guidance
- 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing