mlsanityData to 14 Oct 2026

OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generation

arXiv 2605.21343 ↗First posted 20 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent layout-to-image models have achieved remarkable progress in spatial controllability. However, they still struggle with inter-object occlusion. When bounding boxes overlap, most existing methods lack explicit occlusion information, which makes the generation in intersection regions inherently ambiguous and hinders the determination of complex occlusion relationships. As a result, they often produce entangled textures or physically inconsistent layering in the overlapped areas. To address this issue, we first construct SA-Z, a large-scale dataset enriched with explicit occlusion ordering and pixel-level annotations. Building upon our proposed dataset, we introduce OcclusionFormer, a novel occlusion-aware Diffusion Transformer framework that explicitly models Z-order priority by decoupling instances and compositing them via volume rendering. Furthermore, to ensure fine-grained spatial precision, we introduce a queried alignment loss that explicitly supervises individual instances and enhances semantic consistency. The proposed method effectively reduces ambiguity in overlapping regions, enforces correct occlusion dependencies, and preserves structural integrity, leading to substantial accuracy gains across diverse scenes.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 40 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

33 of 40 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2023Segment Anythingcited by 8,234
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  10. 2025SAM 3: Segment Anything with Conceptscited by 906
  11. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  12. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
21 more
  1. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  2. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  3. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
  4. 2015Semantic Amodal Segmentationcited by 103
  5. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
  6. 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
  7. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
  8. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 41
  9. 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37
  10. 2024Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidancecited by 34
  11. 2025EliGen: Entity-Level Controlled Image Generation with Regional Attentioncited by 33
  12. 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
  13. 2024PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesiscited by 20
  14. 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Modelscited by 18
  15. 2025AnyI2V: Animating Any Conditional Image with Motion Controlcited by 11
  16. 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
  17. 2025Seg2Any: Open-set Segmentation-Mask-to-Image Generation with Precise Shape and Semantic Controlcited by 10
  18. 2025InstanceAssemble: Layout-Aware Image Generation via Instance Assembling Attentioncited by 10
  19. 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 10
  20. 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulationcited by 9
  21. 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Trainingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
  2. 2023LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts
  3. 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
  4. 2026Learning to Generate Multiple Objects from Dense and Occluded Layouts
  5. 2025A Diffusion-Based Framework for Occluded Object Movement
  6. 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers
  7. 2025OccludeNeRF: Geometric-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF
  8. 2025STAY Diffusion: Styled Layout Diffusion Model for Diverse Layout-to-Image Generation