mlsanityData to 7 Oct 2026

TrianguLang: Geometry-Aware Semantic Consensus for Pose-Free 3D Localization

arXiv 2603.08096 ↗First posted 9 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Localizing objects and parts from natural language in 3D space is essential for robotics, AR, and embodied AI, yet existing methods face a trade-off between the accuracy and geometric consistency of per-scene optimization and the efficiency of feed-forward inference. We present TrianguLang, a feed-forward framework for 3D localization that requires no camera calibration at inference. Unlike prior methods that treat views independently, we introduce Geometry-Aware Semantic Attention (GASA), which utilizes predicted geometry to gate cross-view feature correspondence, suppressing semantically-plausible but geometrically-inconsistent matches without requiring ground-truth poses. Validated on five benchmarks including ScanNet++ and uCO3D, TrianguLang achieves state-of-the-art feed-forward text-guided segmentation and localization, reducing user effort from O(N) clicks to a single text query. The model processes each frame at 1008x1008 resolution in ~57ms (~18 FPS) without optimization, enabling practical deployment for interactive robotics and AR applications. Code and checkpoints are available at https://cwru-aism.github.io/triangulang/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

36 of 53 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025SAM 3: Segment Anything with Conceptscited by 835
  6. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  7. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  8. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  9. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  10. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  11. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  12. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
24 more
  1. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  2. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  3. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
  4. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  5. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
  6. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
  7. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  8. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
  9. 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
  10. 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86
  11. 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 77
  12. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  13. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  14. 2023Segment Anything in 3D with Radiance Fieldscited by 61
  15. 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
  16. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  17. 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 47
  18. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 40
  19. 2024Language-Embedded Gaussian Splats (LEGS): Incrementally Building Room-Scale Representations with a Mobile Robotcited by 21
  20. 2025ReferSplat: Referring Segmentation in 3D Gaussian Splattingcited by 20
  21. 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splattingcited by 18
  22. 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fieldscited by 13
  23. 2026Linear Mechanisms for Spatiotemporal Reasoning in Vision Language Modelscited by 11
  24. 2023Align-DETR: Enhancing End-to-end Object Detection with Aligned Losscited by 5

Built on by

Not cited yet.