mlsanityData to 7 Oct 2026

DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming

arXiv 2606.28840 ↗First posted 27 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting~(3DGS) has emerged as a promising paradigm for reconstructing streamable free-viewpoint video~(FVV) from multi-view videos. However, 3DGS-based FVVs typically lack user interaction and editing capabilities, which diminishes the immersive experience. Recent research has integrated language features from CLIP into 3DGS via distillation, enabling open-vocabulary queries and supporting many downstream applications. Nevertheless, the stringent requirements of FVV, low frame size and high FPS, make current language Gaussian representations unsuitable for language-embedded FVV. In this paper, we propose DLGStream, a novel language-embedded FVV representation that streams time-varying language features alongside Gaussian attributes to support 4D environment interaction, scene editing, and spatial intelligence. Specifically, we propose a dual-opacity dynamic language Gaussian representation, which maintains two opacity attributes for color and language features to deal with performance degradation that occurs when colors and features are jointly optimized. Furthermore, we introduce an interpolation-based deformation field to reduce temporal redundancy. This deformation field can also be used for 4D frame interpolation, boosting FVV sequences from low to high FPS. Experimental results demonstrate that DLGStream achieves superior performance in both on open-vocabulary segmentation and reconstruction quality with an average frame size of merely 43 KB. The code is available on hrefhttps://github.com/kkkzh/DLGStreamhttps://github.com/kkkzh/DLGStream.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 106 of its 113 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

106 of 113 references.

References · 106

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  7. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  8. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  9. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  10. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  11. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  12. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
38 more
  1. 2023LERF: Language Embedded Radiance Fieldscited by 538
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  3. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  4. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  5. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
  6. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  7. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  8. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  9. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  10. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  11. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  12. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  13. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  14. 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 232
  15. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  16. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  17. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  18. 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
  19. 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 198
  20. 2023Robust Dynamic Radiance Fieldscited by 193
  21. 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
  22. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  23. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  24. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  25. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  26. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  27. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  28. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  29. 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 110
  30. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  31. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  32. 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 98
  33. 2024CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splattingcited by 80
  34. 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
  35. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  36. 2024End-to-End Rate-Distortion Optimized 3D Gaussian Representationcited by 71
  37. 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 67
  38. 2024Video Interpolation with Diffusion Modelscited by 67

50 most cited of 106 All 106 (JSON)

Built on by

Not cited yet.