Mono4DEditor: Text-Driven 4D Scene Editing from Monocular Video via Point-Level Localization of Language-Embedded Gaussians
Not on the map. Why?
Abstract (arXiv)
Editing 4D scenes reconstructed from monocular videos based on text prompts is a valuable yet challenging task with broad applications in content creation and virtual environments. The key difficulty lies in achieving semantically precise edits in localized regions of complex, dynamic scenes, while preserving the integrity of unedited content. To address this, we introduce Mono4DEditor, a novel framework for flexible and accurate text-driven 4D scene editing. Our method augments 3D Gaussians with quantized CLIP features to form a language-embedded dynamic representation, enabling efficient semantic querying of arbitrary spatial regions. We further propose a two-stage point-level localization strategy that first selects candidate Gaussians via CLIP similarity and then refines their spatial extent to improve accuracy. Finally, targeted edits are performed on localized regions using a diffusion-based video editing model, with flow and scribble guidance ensuring spatial fidelity and temporal coherence. Extensive experiments demonstrate that Mono4DEditor enables high-quality, text-driven edits across diverse scenes and object types, while preserving the appearance and geometry of unedited areas and surpassing prior approaches in both flexibility and visual fidelity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 55 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
50 of 55 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
38 more
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2019The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object Segmentationcited by 95
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2022Learning to generate line drawings that convey geometry and semanticscited by 82
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 65
- 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
- 2023Control4D: Efficient 4D Portrait Editing with Textcited by 32
- 2024SketchDream: Sketch-based Text-to-3D Generation and Editingcited by 25
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splattingcited by 25
- 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fieldscited by 13
- 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editingcited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer
- 20254DGS-Craft: Consistent and Interactive 4D Gaussian Splatting Editing
- 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
- 2026Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing
- 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
- 2025Splat4D: Diffusion-Enhanced 4D Gaussian Splatting for Temporally and Spatially Consistent Content Creation