mlsanityData to 14 Oct 2026

PLAF: Pixel-wise Language-Aligned Feature Extraction for Efficient 3D Scene Understanding

arXiv 2604.15770 ↗First posted 17 Apr 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate open-vocabulary 3D scene understanding requires semantic representations that are both language-aligned and spatially precise at the pixel level, while remaining scalable when lifted to 3D space. However, existing representations struggle to jointly satisfy these requirements, and densely propagating pixel-wise semantics to 3D often results in substantial redundancy, leading to inefficient storage and querying in large-scale scenes. To address these challenges, we present PLAF, a Pixel-wise Language-Aligned Feature extraction framework that enables dense and accurate semantic alignment in 2D without sacrificing open-vocabulary expressiveness. Building upon this representation, we further design an efficient semantic storage and querying scheme that significantly reduces redundancy across both 2D and 3D domains. Experimental results show that PLAF provides a strong semantic foundation for accurate and efficient open-vocabulary 3D scene understanding. The codes are publicly available at https://github.com/RockWenJJ/PLAF.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

16 of 18 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  6. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  7. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 304
  8. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
  9. 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 184
  10. 2023AM-RADIO: Agglomerative Vision Foundation Model -- Reduce All Domains Into Onecited by 169
  11. 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
  12. 2024RADIOv2.5: Improved Baselines for Agglomerative Vision Foundation Modelscited by 89
4 more
  1. 2023Fully Sparse 3D Occupancy Predictioncited by 64
  2. 2025Inst3D-LMM: Instance-Aware 3D Scene Understanding with Multi-modal Instruction Tuningcited by 51
  3. 2022Neural Compression-Based Feature Learning for Video Restorationcited by 23
  4. 2025RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Explorationcited by 23

Built on by

Not cited yet.