mlsanityData to 14 Oct 2026

POCI-Diff: 3D-Layout Guided Diffusion for Controllable Synthetic Surveillance Data Generation

arXiv 2601.14056 ↗First posted 20 Jan 2026cs.CV cs.AIcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Training robust visual surveillance models requires large-scale datasets with precise spatial annotations, yet collecting real surveillance data is costly, privacy-sensitive, and often legally constrained. Synthetic data generation offers a compelling alternative, but existing methods lack fine-grained 3D control over object placement and appearance, limiting geometric consistency across camera viewpoints. We introduce POCI-Diff (Positioning Objects Consistently and Interactively), a framework that generates annotated synthetic scenes from explicit 3D bounding-box layouts with per-object semantic control. By integrating Blended Latent Diffusion with depth-conditioned ControlNet, POCI-Diff synthesises complex multi-object scenes in a single forward pass, binding individual text descriptions to specific 3D locations. We further propose a warping-free editing pipeline supporting object insertion, removal, and transformation via regeneration, enabling efficient scene variation for data augmentation. Object identity across edits is preserved by conditioning on reference images via IP-Adapter, ensuring appearance consistency throughout interactive scene manipulation. Experiments show that POCI-Diff outperforms state-of-the-art 3D layout-guided generation methods in visual fidelity and layout adherence, while eliminating warping-induced geometric artifacts.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 21 of its 24 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

21 of 24 references.

References · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  7. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  8. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  9. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  10. 2022Blended Latent Diffusioncited by 432
  11. 2017NIMA: Neural Image Assessmentcited by 389
  12. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
9 more
  1. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
  2. 2023Real-Time Flying Object Detection with YOLOv8cited by 94
  3. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 89
  4. 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
  5. 2024Build-A-Scene: Interactive 3D Layout Control for Diffusion-Based Image Generationcited by 18
  6. 2024Synthesizing Efficient Data with Diffusion Models for Person Re-Identification Pre-Trainingcited by 11
  7. 2025Diffusion-based Synthetic Data Generation for Visible-Infrared Person Re-Identificationcited by 10
  8. 2023Diffusion Dataset Generation: Towards Closing the Sim2Real Gap for Pedestrian Detectioncited by 3
  9. 2025ESPLoRA: Enhanced Spatial Precision with Low-Rank Adaption in Text-to-Image Diffusion Models for High-Definition Synthesiscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priors
  2. 2025LACONIC: A 3D Layout Adapter for Controllable Image Creation
  3. 2023LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts
  4. 2025Setting the Stage: Text-Driven Scene-Consistent Image Generation
  5. 2026AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation
  6. 2025CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-step
  7. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
  8. 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generation