BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editing
Not on the map. Why?
Abstract (arXiv)
Coarse-mask local image editing asks a model to modify a user-indicated region while preserving the surrounding scene. In practice, however, rough masks often become unintended shape priors: instead of serving as flexible edit support, the mask can pull the generated object toward its accidental boundary. We study this failure as mask-shape bias and frame the task through a Two-Zone Constraint, where the background should remain stable while the editable region should follow the instruction without being forced to inherit the mask contour. BRIDGE addresses this setting by keeping masks outside the DiT backbone for support construction and blending, avoiding DiT-internal mask injection and copied control branches. It uses BridgePath generation, where a Main Path preserves background context and a Subject Path generates editable content from independent noise. Motivated by a diagnostic Qwen-Image experiment showing that positional embeddings and attention connectivity regulate which image context visual tokens reuse, BRIDGE introduces a learnable Discrete Geometric Gate for token-level positional-embedding routing. This gate lets subject tokens borrow background-anchored coordinates near fusion regions or keep subject-centric coordinates for geometric freedom. We evaluate BRIDGE on BRIDGE-Bench, MagicBrush, and ICE-Bench. On BRIDGE-Bench, BRIDGE improves Local SigLIP2-T from 0.262 with FLUX.1-Fill and 0.390 with ACE++ to 0.503, with parallel gains in local DINO and DreamSim. Zero-shot results on MagicBrush and ICE-Bench further indicate competitive alignment and source preservation beyond the curated benchmark, while the added routing module remains compact at 13.31M parameters compared with ControlNet-style copied branches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
42 of 46 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
30 more
- 2025DINOv3cited by 1,414
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Blended Latent Diffusioncited by 432
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2024The Road Less Scheduledcited by 163
- 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 133
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
- 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 24
- 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformerscited by 14
- 2026Diffusion Templates: A Unified Plugin Framework for Controllable Diffusioncited by 3
- 2025PosBridge: Multi-View Positional Embedding Transplant for Identity-Aware Image Editingcited by 1
Built on by
Not cited yet.