MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors
Not on the map. Why?
Abstract (arXiv)
Autonomous driving systems rely heavily on multimodal perception data to understand complex environments. However, the long-tailed distribution of real-world data hinders generalization, especially for rare but safety-critical vehicle categories. To address this challenge, we propose MultiEditor, a dual-branch latent diffusion framework designed to edit images and LiDAR point clouds in driving scenarios jointly. At the core of our approach is introducing 3D Gaussian Splatting (3DGS) as a structural and appearance prior for target objects. Leveraging this prior, we design a multi-level appearance control mechanism--comprising pixel-level pasting, semantic-level guidance, and multi-branch refinement--to achieve high-fidelity reconstruction across modalities. We further propose a depth-guided deformable cross-modality condition module that adaptively enables mutual guidance between modalities using 3DGS-rendered depth, significantly enhancing cross-modality consistency. Extensive experiments demonstrate that MultiEditor achieves superior performance in visual and geometric fidelity, editing controllability, and cross-modality consistency. Furthermore, generating rare-category vehicle data with MultiEditor substantially enhances the detection accuracy of perception models on underrepresented classes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 29 Jul 2025.
Builds on
31 of 43 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
19 more
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flowcited by 123
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 67
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
- 2024SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Controlcited by 32
- 2024Omni-Scene: Omni-Gaussian Representation for Ego-Centric Sparse-View Scene Reconstructioncited by 32
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformercited by 26
- 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
- 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 17
- 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarioscited by 13
- 2024GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDARcited by 12
- 2025DualDiff: Dual-branch Diffusion Model for Autonomous Driving with Semantic Fusioncited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
- 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenes
- 2025SceneCrafter: Controllable Multi-View Driving Scene Editing
- 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
- 2025MuDG: Taming Multi-modal Diffusion with Gaussian Splatting for Urban Scene Reconstruction
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
- 2025Mirage: One-Step Video Diffusion for Photorealistic and Coherent Asset Editing in Driving Scenes
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting