Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We present Edit3DGS, a unified framework for dynamic 3D head editing that integrates 2D instruction-guided diffusion with 3D Gaussian splatting. Unlike prior approaches that separately address frame-based edits or static 3D reconstruction, our method couples semantic controllability in the image domain with photorealistic, temporally consistent 3D representations. Given an input video, editable facial regions are masked and modified using a text-conditioned diffusion model to support fine-grained operations such as expression transformation, attribute modification, and appearance refinement. The edited frames are then aggregated through 3D Gaussian splatting to produce a coherent, high-fidelity avatar that preserves both identity and motion dynamics. To enforce consistency, Edit3DGS incorporates multi-view batch editing and lightweight inpainting strategies that recover lost expressions across timesteps. Experimental results demonstrate that our framework enables controllable, artifact-free head editing with smooth temporal transitions, offering practical applications in virtual avatars, immersive communication, film production, and interactive media.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 19 of its 24 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
19 of 24 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
6 more
- 2023Relightable Gaussian Codec Avatarscited by 126
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
- 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DynamicAvatars: Accurate Dynamic Facial Avatars Reconstruction and Precise Editing with Diffusion Models
- 2023Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars
- 2025Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance
- 2023Instruct-Video2Avatar: Video-to-Avatar Generation with Instructions
- 2023HeadSculpt: Crafting 3D Head Avatars with Text
- 2024ShapeFusion: A 3D diffusion model for localized shape editing
- 2026FG-Portrait: 3D Flow Guided Editable Portrait Animation