VideoReloc: Long-Term Indoor Video Relocalization against a Kilobyte-Scale Semantic Scene Graph
Not on the map. Why?
Abstract (arXiv)
Given a compact semantic scene graph, long-term indoor video relocalization estimates a map-frame trajectory after lighting and furniture changes. Visual methods rely on appearance and become unreliable under these changes; localizing one frame at a time from object classes and geometry instead leaves sparse, ambiguous evidence. We introduce VideoReloc, whose adaptive clips use odometry to gather spatial evidence until object and motion criteria are met, adapting query length to the observed scene. Its run-level decision rechecks conflicting placements using evidence accumulated across connected clips, stabilizing the trajectory beyond adjacent-clip tracking. Hypothesis-first registration proposes poses from object triplets and verifies each using clip-wide object centers and box surfaces. Orientation-aware refinement uses box faces, gravity and wall directions to resolve ambiguity in camera orientation and refine the full pose. This reframes sparse-map relocalization as verification of spatially extended video queries, moving discriminative support from stored appearance to temporal context and permitting a 100 kB map of class-labelled boxes. On RIO10 and ReplicaCAD, the all-frame localization success rate at 1 m/10^circ is 73.5% and 61.1% under causal evaluation, rising to 90.6% and 74.8% with clip closure. The evaluated per-frame scene coordinate regressors reach up to 47.6% and 49.8%, respectively, with maps of 12.6-42 MB. Project page: https://videoreloc.github.io
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
27 of 36 references.
References · 27
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2018QuadricSLAM: Dual Quadrics from Object Detections as Landmarks in Object-oriented SLAMcited by 86
- 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labelscited by 64
15 more
- 2020Beyond Controlled Environments: 3D Camera Re-Localization in Changing Indoor Scenescited by 31
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2024SceneGraphLoc: Cross-Modal Coarse Visual Localization on 3D Scene Graphscited by 29
- 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
- 2022STD: Stable Triangle Descriptor for 3D place recognitioncited by 23
- 2022OA-SLAM: Leveraging Objects for Camera Relocalization in Visual SLAMcited by 17
- 2025R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localizationcited by 17
- 2024ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localizationcited by 10
- 2023Outram: One-shot Global Localization via Triangulated Scene Graph and Global Outlier Pruningcited by 9
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Trainingcited by 9
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registrationcited by 8
- 2024GOReloc: Graph-based Object-Level Relocalization for Visual SLAMcited by 7
- 2025MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localizationcited by 1
- 2026Compact Object-Level Representations with Open-Vocabulary Understanding for Indoor Visual Relocalizationcited by 1
- 2026Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputscited by 1
Built on by
Not cited yet.