mlsanityData to 7 Oct 2026

EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models

arXiv 2606.09273 ↗First posted 8 Jun 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

3D semantic scene generation is crucial for autonomous driving applications, yet most methods rely on complex 3D-specific architectures such as triplane encoders and adapted diffusion networks, limiting both their simplicity and their editing capabilities. We propose EditSSC, an editing-ready method for 3D semantic scene generation using 2D Bird's Eye View (BEV) representations and off-the-shelf latent diffusion network. Our approach reshapes 3D semantic occupancy grids into multi-channel BEV images and leverages the quantized autoencoder and UNet from Stable Diffusion with minimal modifications. We perform diffusion on the latents after quantization, which enables training-free editing capabilities. By exploiting class-to-code correspondences in the codebook, our method supports sketch-guided generation, inpainting, and outpainting without any retraining. On SemanticKITTI, EditSSC outperforms existing 3D-specific baselines on unconditional generation, demonstrating that well-established 2D architectures can be effectively repurposed for 3D scene generation and editing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 37 of its 43 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

37 of 43 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusion21 Jan
  2. 2024SSEditor: Controllable Mask-to-Scene Generation with Diffusion Model19 Nov
  3. 2024DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models26 Sep
  4. 2024LT3SD: Latent Trees for 3D Scene Diffusion12 Sep
  5. 2024SemCity: Semantic Scene Generation with Triplane Diffusion12 Mar
  6. 2023Pyramid Diffusion for Fine 3D Large Scene Generation20 Nov
  7. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models19 Apr
  8. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis24 Mar
  9. 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data2 Jan
  10. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  11. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  12. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
1 more
  1. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 24

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2017Neural Discrete Representation Learningcited by 4,650
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  7. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  8. 2018Demystifying MMD GANscited by 1,268
  9. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  10. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  11. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  12. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
12 more
  1. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  2. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  3. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  4. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  5. 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 85
  6. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  7. 2023CC3D: Layout-Conditioned Generation of Compositional 3D Scenescited by 58
  8. 2018Two Stream 3D Semantic Scene Completioncited by 48
  9. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
  10. 2025Latent Diffusion Models with Masked AutoEncoderscited by 11
  11. 2025MatSwap: Light-aware material transfers in imagescited by 6
  12. 2025ShapeShifter: 3D Variations Using Multiscale and Sparse Point-Voxel Diffusioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Urban Scene Diffusion through Semantic Occupancy Map
  2. 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation
  3. 2026SEM-ROVER: Semantic Voxel-Guided Diffusion for Large-Scale Driving Scene Generation
  4. 2024SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIs
  5. 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
  6. 2025HD2-SSC: High-Dimension High-Density Semantic Scene Completion for Autonomous Driving
  7. 2025Controllable 3D Outdoor Scene Generation via Scene Graphs
  8. 2026SemanticNVS: Improving Semantic Scene Understanding in Generative Novel View Synthesis