OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank
Not on the map. Why?
Abstract (arXiv)
Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot represent their occlusion order. Existing methods may rely on additional geometric conditions, employ complex inference procedures, or aggregate independently constructed instance representations without explicitly modeling their occlusion-dependent interactions. We propose OccluRank, a simple and controllable occlusion-aware layout-to-image framework that augments each bounding box with only one ordinal rank. OccluRank encodes the user-specified occlusion order through lightweight rank-based conditioning and introduces an Order-aware Instance Interaction (OII) module to jointly update rank-conditioned instance representations before aggregation. This allows the specified order to guide information exchange among occluding instances without additional geometric inputs or specialized inference-time optimization. We further construct OccluLayout, a synthetic training dataset whose occlusion order and amodal annotations are derived directly from known scene geometry rather than estimated from partially occluded images using auxiliary prediction models. For comprehensive evaluation, we introduce OccluLayout-Bench, which uses multiple multimodal large language model evaluators to assess instance presence, spatial layout, attributes, and occlusion order, together with FID for overall image quality. Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired occlusion relationships while maintaining comparable attribute consistency and overall image quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 28 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
23 of 28 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2015Semantic Amodal Segmentationcited by 103
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
11 more
- 2025EliGen: Entity-Level Controlled Image Generation with Regional Attentioncited by 33
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2023LoCo: Locally Constrained Training-Free Layout-to-Image Synthesiscited by 21
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Modelscited by 10
- 2025Seg2Any: Open-set Segmentation-Mask-to-Image Generation with Precise Shape and Semantic Controlcited by 10
- 2025InstanceAssemble: Layout-Aware Image Generation via Instance Assembling Attentioncited by 10
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
- 2025MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansioncited by 4
- 2026DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesiscited by 1
- 2026OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Generate Multiple Objects from Dense and Occluded Layouts
- 2023LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning
- 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generation
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation
- 2025OccludeNeRF: Geometric-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF
- 2026Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
- 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Models