mlsanityData to 7 Oct 2026

SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generation

arXiv 2602.23359 ↗First posted 26 Feb 2026cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

We identify occlusion reasoning as a fundamental yet overlooked aspect for 3D layout-conditioned generation. It is essential for synthesizing partially occluded objects with depth-consistent geometry and scale. While existing methods can generate realistic scenes that follow input layouts, they often fail to model precise inter-object occlusions. We propose SeeThrough3D, a model for 3D layout conditioned generation that explicitly models occlusions. We introduce an occlusion-aware 3D scene representation (OSCR), where objects are depicted as translucent 3D boxes placed within a virtual environment and rendered from desired camera viewpoint. The transparency encodes hidden object regions, enabling the model to reason about occlusions, while the rendered viewpoint provides explicit camera control during generation. We condition a pretrained flow based text-to-image image generation model by introducing a set of visual tokens derived from our rendered 3D representation. Furthermore, we apply masked self-attention to accurately bind each object bounding box to its corresponding textual description, enabling accurate generation of multiple objects without object attribute mixing. To train the model, we construct a synthetic dataset with diverse multi-object scenes with strong inter-object occlusions. SeeThrough3D generalizes effectively to unseen object categories and enables precise 3D layout control with realistic occlusions and consistent camera control.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 65 of its 76 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

65 of 76 references.

References · 65

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Segment Anythingcited by 8,158
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
38 more
  1. 2018Demystifying MMD GANscited by 1,268
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  3. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  4. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  5. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  6. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  7. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
  8. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  9. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  10. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
  11. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 89
  12. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  13. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 73
  14. 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
  15. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
  16. 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 56
  17. 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
  18. 2023Generative Models: What Do They Know? Do They Know Things? Let's Find Out!cited by 50
  19. 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
  20. 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
  21. 2023Amodal Ground Truth and Completion in the Wildcited by 43
  22. 2024GeoDiffuser: Geometry-Based Image Editing with Diffusion Modelscited by 34
  23. 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
  24. 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splattingcited by 25
  25. 2019Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusioncited by 24
  26. 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
  27. 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editingcited by 19
  28. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  29. 2024Build-A-Scene: Interactive 3D Layout Control for Diffusion-Based Image Generationcited by 18
  30. 2024Object-level Scene Deocclusioncited by 17
  31. 2024Learning Continuous 3D Words for Text-to-Image Generationcited by 16
  32. 2024Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflectionscited by 16
  33. 20233D-aware Blending with Generative NeRFscited by 13
  34. 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
  35. 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priorscited by 12
  36. 20253D-Fixup: Advancing Photo Editing with 3D Priorscited by 12
  37. 2024Text2Place: Affordance-aware Text Guided Human Placementcited by 11
  38. 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.