mlsanityData to 7 Oct 2026

Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass

arXiv 2603.17841 ↗First posted 18 Mar 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Most instruction-driven 3D editing methods rely on 2D models to guide the explicit and iterative optimization of 3D representations. This paradigm, however, suffers from two primary drawbacks. First, it lacks a universal design of different 3D editing tasks because the explicit manipulation of 3D geometry necessitates task-dependent rules, e.g., 3D appearance editing demands inherent source 3D geometry, while 3D removal alters source geometry. Second, the iterative optimization process is highly time-consuming, often requiring thousands of invocations of 2D/3D updating. We present Omni-3DEdit, a unified, learning-based model that generalizes various 3D editing tasks implicitly. One key challenge to achieve our goal is the scarcity of paired source-edited multi-view assets for training. To address this issue, we construct a data pipeline, synthesizing a relatively rich number of high-quality paired multi-view editing samples. Subsequently, we adapt the pre-trained generative model SEVA as our backbone by concatenating source view latents along with conditional tokens in sequence space. A dual-stream LoRA module is proposed to disentangle different view cues, largely enhancing our model's representational learning capability. As a learning-based model, our model is free of the time-consuming online optimization, and it can complete various 3D editing tasks in one forward pass, reducing the inference time from tens of minutes to approximately two minutes. Extensive experiments demonstrate the effectiveness and efficiency of Omni-3DEdit.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 80 of its 87 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

80 of 87 references.

References · 80

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  9. 2024Qwen2 Technical Reportcited by 2,076
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
  1. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  2. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  3. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  4. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  5. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  6. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  8. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  9. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  10. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  11. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  12. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  13. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  14. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  15. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  16. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  17. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
  18. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  19. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  20. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  21. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
  22. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
  23. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 109
  24. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
  25. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
  26. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  27. 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
  28. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  29. 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
  30. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
  31. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 45
  32. 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
  33. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  34. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
  35. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  36. 2024Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Modelcited by 30
  37. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  38. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.