TrianguLang: Geometry-Aware Semantic Consensus for Pose-Free 3D Localization
Not on the map. Why?
Abstract (arXiv)
Localizing objects and parts from natural language in 3D space is essential for robotics, AR, and embodied AI, yet existing methods face a trade-off between the accuracy and geometric consistency of per-scene optimization and the efficiency of feed-forward inference. We present TrianguLang, a feed-forward framework for 3D localization that requires no camera calibration at inference. Unlike prior methods that treat views independently, we introduce Geometry-Aware Semantic Attention (GASA), which utilizes predicted geometry to gate cross-view feature correspondence, suppressing semantically-plausible but geometrically-inconsistent matches without requiring ground-truth poses. Validated on five benchmarks including ScanNet++ and uCO3D, TrianguLang achieves state-of-the-art feed-forward text-guided segmentation and localization, reducing user effort from O(N) clicks to a single text query. The model processes each frame at 1008x1008 resolution in ~57ms (~18 FPS) without optimization, enabling practical deployment for interactive robotics and AR applications. Code and checkpoints are available at https://cwru-aism.github.io/triangulang/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
36 of 53 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
24 more
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2023An Embodied Generalist Agent in 3D Worldcited by 355
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
- 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 77
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2023Segment Anything in 3D with Radiance Fieldscited by 61
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
- 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 47
- 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 40
- 2024Language-Embedded Gaussian Splats (LEGS): Incrementally Building Room-Scale Representations with a Mobile Robotcited by 21
- 2025ReferSplat: Referring Segmentation in 3D Gaussian Splattingcited by 20
- 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splattingcited by 18
- 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fieldscited by 13
- 2026Linear Mechanisms for Spatiotemporal Reasoning in Vision Language Modelscited by 11
- 2023Align-DETR: Enhancing End-to-end Object Detection with Aligned Losscited by 5
Built on by
Not cited yet.