DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis
Not on the map. Why?
Abstract (arXiv)
Text-to-image models often struggle to synthesize correct occlusion relationships among multiple objects, especially in densely overlapping regions. Many training-free layout-guided methods enforce 2D spatial constraints but do not explicitly resolve depth-dependent attention competition, which can cause concept mixing and implausible occlusion. To address this problem, we propose DepthArb, a training-free framework that formulates occlusion generation as attention arbitration within a unified denoising trajectory. DepthArb employs two core occlusion-control mechanisms: Attention Arbitration Modulation suppresses background-object attention within foreground support according to relative depth, while Spatial Compactness Control limits attention dispersion to preserve object coherence. Because interference varies during generation, Occlusion Conflict Estimation constructs a shared spatial conflict field to adaptively weight both objectives. Through a unified spatial-text attention interface, DepthArb operates on U-Net cross-attention and the image-to-text component of MMDiT joint attention without model retraining. We further introduce OcclBench, a benchmark with continuous relative-depth specifications and occlusion-specific evaluation metrics. Experiments on OcclBench and public benchmarks show that DepthArb improves several layout and occlusion metrics over the evaluated baselines while maintaining competitive text-image alignment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 60 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
55 of 60 references.
References · 55
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 233
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
- 2022Benchmarking Spatial Relationships in Text-to-Image Generationcited by 96
- 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 94
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 82
- 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidancecited by 69
- 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
- 2023Mixture of Diffusers for scene composition and high resolution image generationcited by 56
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 38
- 2023R&B: Region and Boundary Aware Zero-shot Grounded Text-to-image Generationcited by 29
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
- 2024Training-free Regional Prompting for Diffusion Transformerscited by 26
- 2024GrounDiT: Grounding Diffusion Transformers via Noisy Patch Transplantationcited by 24
- 2024OneActor: Consistent Character Generation via Cluster-Conditioned Guidancecited by 15
- 2022DAG: Depth-Aware Guidance with Denoising Diffusion Probabilistic Modelscited by 12
- 2024SpotActor: Training-Free Layout-Controlled Consistent Image Generationcited by 12
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
- 2025EchoMotion: Unified Human Video and Motion Generation via Dual-Modality Diffusion Transformercited by 11
- 2025DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editabilitycited by 10
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.