Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass
Not on the map. Why?
Abstract (arXiv)
Most instruction-driven 3D editing methods rely on 2D models to guide the explicit and iterative optimization of 3D representations. This paradigm, however, suffers from two primary drawbacks. First, it lacks a universal design of different 3D editing tasks because the explicit manipulation of 3D geometry necessitates task-dependent rules, e.g., 3D appearance editing demands inherent source 3D geometry, while 3D removal alters source geometry. Second, the iterative optimization process is highly time-consuming, often requiring thousands of invocations of 2D/3D updating. We present Omni-3DEdit, a unified, learning-based model that generalizes various 3D editing tasks implicitly. One key challenge to achieve our goal is the scarcity of paired source-edited multi-view assets for training. To address this issue, we construct a data pipeline, synthesizing a relatively rich number of high-quality paired multi-view editing samples. Subsequently, we adapt the pre-trained generative model SEVA as our backbone by concatenating source view latents along with conditional tokens in sequence space. A dual-stream LoRA module is proposed to disentangle different view cues, largely enhancing our model's representational learning capability. As a learning-based model, our model is free of the time-consuming online optimization, and it can complete various 3D editing tasks in one forward pass, reducing the inference time from tens of minutes to approximately two minutes. Extensive experiments demonstrate the effectiveness and efficiency of Omni-3DEdit.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 80 of its 87 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
80 of 87 references.
References · 80
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024Qwen2 Technical Reportcited by 2,076
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 109
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 45
- 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Modelcited by 30
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Spacecited by 1
- 2026VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Predictioncited by 0
- 2026GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changescited by 0
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Imagescited by 0
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimizationcited by 0
- 2026OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization24 Sep 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space11 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changes3 Jun 2026
- 2026VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction14 May 2026