Route-MHT: Multimodal Transformer Guardrails for Thermal Visual Place Recognition
Not on the map. Why?
Abstract (arXiv)
Strong mapped-region thermal visual place recognition (VPR) does not ensure safe rejection of unmapped queries. We identify and quantify this gap in AnyThermal: high Map-In retrieval accuracy coexists with confident false loop closures in Map-Out. We address it with ROUTE-MHT, a multimodal transformer guardrail. Causal motion forms a route-local candidate pool beyond the frontend's Top-K. Closed-form SE(2) SVD verifies candidates, while frozen visual features, nine-dimensional SVD residuals, and motion proxies enter a masked multi-head transformer (MHT). Their interactions yield a contextual confidence correction to reject unsupported matches without altering geometric pose alignment. We collect an indoor thermal dataset with a physical mobile robot (Dataset-A), forming five same-day/cross-day map-query pairs; the protected interface reaches macro R@1@5m of .610/.861. Dataset-B comprises 20 map-hole scenarios derived from public STheReO-KAIST recordings. Across five scenario-held-out folds and three seeds, ROUTE-MHT reduces FPR from .116 for the SVD baseline to .061 (paired 95% CI [-.100, -.014]), while improving AUC from .945 to .967 and recall from .884 to .914. Public benchmark transfer checks on STheReO-KAIST, MS2, and IRSLAM-KRI extend the evaluation under their released metric or route-progress protocols.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
19 of 31 references.
References · 19
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,439
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,327
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,169
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 984
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 160
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
7 more
- 2022Learning Sequential Descriptors for Sequence-based Visual Place Recognitioncited by 25
- 2024On the Estimation of Image-matching Uncertainty in Visual Place Recognitioncited by 15
- 2024Pair-VPR: Place-Aware Pre-training and Contrastive Pair Classification for Visual Place Recognition with Vision Transformerscited by 15
- 2020Unsupervised Learning Methods for Visual Place Recognition in Discretely and Continuously Changing Environmentscited by 14
- 2024Towards Long Term SLAM on Thermal Imagerycited by 4
- 2025Deep Depth Estimation from Thermal Image: Dataset, Benchmark, and Challengescited by 4
- 2026AnyThermal: Towards Learning Universal Representations for Thermal Perceptioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025TeTRA-VPR: A Ternary Transformer Approach for Compact Visual Place Recognition
- 2026ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
- 2025FastMap: Real-Time Semantic Map Completion via Bitwise Masked Modeling
- 2026Are All Tokens Necessary for Visual Place Recognition? An Empirical Study of Token Reduction for Efficient Inference
- 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning
- 2025Scale, Don't Fine-tune: Guiding Multimodal LLMs for Efficient Visual Place Recognition at Test-Time
- 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognition
- 2026HEARTH: An Object-Centric RGB-Thermal-3D Dataset for Temperature-Aware Robot Manipulation ↗