SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
We identify occlusion reasoning as a fundamental yet overlooked aspect for 3D layout-conditioned generation. It is essential for synthesizing partially occluded objects with depth-consistent geometry and scale. While existing methods can generate realistic scenes that follow input layouts, they often fail to model precise inter-object occlusions. We propose SeeThrough3D, a model for 3D layout conditioned generation that explicitly models occlusions. We introduce an occlusion-aware 3D scene representation (OSCR), where objects are depicted as translucent 3D boxes placed within a virtual environment and rendered from desired camera viewpoint. The transparency encodes hidden object regions, enabling the model to reason about occlusions, while the rendered viewpoint provides explicit camera control during generation. We condition a pretrained flow based text-to-image image generation model by introducing a set of visual tokens derived from our rendered 3D representation. Furthermore, we apply masked self-attention to accurately bind each object bounding box to its corresponding textual description, enabling accurate generation of multiple objects without object attribute mixing. To train the model, we construct a synthetic dataset with diverse multi-object scenes with strong inter-object occlusions. SeeThrough3D generalizes effectively to unseen object categories and enables precise 3D layout control with realistic occlusions and consistent camera control.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 65 of its 76 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
65 of 76 references.
References · 65
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
38 more
- 2018Demystifying MMD GANscited by 1,268
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 89
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 73
- 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 56
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2023Generative Models: What Do They Know? Do They Know Things? Let's Find Out!cited by 50
- 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
- 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2024GeoDiffuser: Geometry-Based Image Editing with Diffusion Modelscited by 34
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splattingcited by 25
- 2019Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusioncited by 24
- 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
- 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editingcited by 19
- 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
- 2024Build-A-Scene: Interactive 3D Layout Control for Diffusion-Based Image Generationcited by 18
- 2024Object-level Scene Deocclusioncited by 17
- 2024Learning Continuous 3D Words for Text-to-Image Generationcited by 16
- 2024Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflectionscited by 16
- 20233D-aware Blending with Generative NeRFscited by 13
- 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
- 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priorscited by 12
- 20253D-Fixup: Advancing Photo Editing with 3D Priorscited by 12
- 2024Text2Place: Affordance-aware Text Guided Human Placementcited by 11
- 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026When Identities Collapse: A Stress-Test Benchmark for Multi-Subject Personalizationcited by 2
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easycited by 0
- 2026Keep The Essentials: Efficient Reference Conditioned Generation via Token Droppingcited by 0
- 2026Learning to Generate Multiple Objects from Dense and Occluded Layoutscited by 0
- 2026Learning to Generate Multiple Objects from Dense and Occluded Layouts3 Jul 2026
- 2026Keep The Essentials: Efficient Reference Conditioned Generation via Token Dropping22 Jun 2026
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easy18 Jun 2026
- 2026When Identities Collapse: A Stress-Test Benchmark for Multi-Subject Personalization27 Mar 2026