ProFuse: Efficient Cross-View Context Fusion for Open-Vocabulary 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
We present ProFuse, an efficient context-aware framework for open-vocabulary 3D scene understanding with 3D Gaussian Splatting (3DGS). The pipeline enhances cross-view consistency and intra-mask cohesion within a direct registration setup, adding minimal overhead and requiring no render-supervised fine-tuning. Instead of relying on a pretrained 3DGS scene, we introduce a dense correspondence-guided pre-registration phase that initializes Gaussians with accurate geometry while jointly constructing 3D Context Proposals via cross-view clustering. Each proposal carries a global feature obtained through weighted aggregation of member embeddings, and this feature is fused onto Gaussians during direct registration to maintain per-primitive language coherence across views. With associations established in advance, semantic fusion requires no additional optimization beyond standard reconstruction, and the model retains geometric refinement without densification. ProFuse achieves strong open-vocabulary 3DGS understanding while completing semantic attachment in about five minutes per scene, which is two times faster than SOTA. Additional details are available at our project page https://chiou1203.github.io/ProFuse/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 41 of its 45 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
41 of 45 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2023LERF: Language Embedded Radiance Fieldscited by 538
29 more
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2022Visual Language Maps for Robot Navigationcited by 362
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2023Segment Any 3D Gaussianscited by 158
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
- 2023Distilled Feature Fields Enable Few-Shot Language-Guided Manipulationcited by 130
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
- 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
- 2023Open-Fusion: Real-time Open-Vocabulary 3D Mapping and Queryable Scene Representationcited by 54
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 50
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 42
- 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
- 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23
- 2025EDGS: Eliminating Densification for Efficient Convergence of 3DGScited by 21
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
- 2024UniM-OV3D: Uni-Modality Open-Vocabulary 3D Scene Understanding with Fine-Grained Feature Representationcited by 15
- 2025Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracingcited by 13
- 2025CAGS: Open-Vocabulary 3D Scene Understanding with Context-Aware Gaussian Splattingcited by 11
- 2024LoFLAT: Local Feature Matching using Focused Linear Attention Transformercited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.