mlsanityData to 7 Oct 2026

MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors

arXiv 2507.21872 ↗First posted 29 Jul 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous driving systems rely heavily on multimodal perception data to understand complex environments. However, the long-tailed distribution of real-world data hinders generalization, especially for rare but safety-critical vehicle categories. To address this challenge, we propose MultiEditor, a dual-branch latent diffusion framework designed to edit images and LiDAR point clouds in driving scenarios jointly. At the core of our approach is introducing 3D Gaussian Splatting (3DGS) as a structural and appearance prior for target objects. Leveraging this prior, we design a multi-level appearance control mechanism--comprising pixel-level pasting, semantic-level guidance, and multi-branch refinement--to achieve high-fidelity reconstruction across modalities. We further propose a depth-guided deformable cross-modality condition module that adaptively enables mutual guidance between modalities using 3DGS-rendered depth, significantly enhancing cross-modality consistency. Extensive experiments demonstrate that MultiEditor achieves superior performance in visual and geometric fidelity, editing controllability, and cross-modality consistency. Furthermore, generating rare-category vehicle data with MultiEditor substantially enhances the detection accuracy of perception models on underrepresented classes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

31 of 43 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  10. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  11. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  12. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
19 more
  1. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  2. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  3. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  4. 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flowcited by 123
  5. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
  6. 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 67
  7. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  8. 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
  9. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
  10. 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
  11. 2024SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Controlcited by 32
  12. 2024Omni-Scene: Omni-Gaussian Representation for Ego-Centric Sparse-View Scene Reconstructioncited by 32
  13. 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformercited by 26
  14. 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
  15. 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
  16. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 17
  17. 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarioscited by 13
  18. 2024GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDARcited by 12
  19. 2025DualDiff: Dual-branch Diffusion Model for Autonomous Driving with Semantic Fusioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
  2. 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenes
  3. 2025SceneCrafter: Controllable Multi-View Driving Scene Editing
  4. 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
  5. 2025MuDG: Taming Multi-modal Diffusion with Gaussian Splatting for Urban Scene Reconstruction
  6. 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
  7. 2025Mirage: One-Step Video Diffusion for Photorealistic and Coherent Asset Editing in Driving Scenes
  8. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting