YOWO: You Only Walk Once to Jointly Map An Indoor Scene and Register Ceiling-mounted Cameras
Not on the map. Why?
Abstract (arXiv)
Using ceiling-mounted cameras (CMCs) for indoor visual capturing opens up a wide range of applications. However, registering CMCs to the target scene layout presents a challenging task. While manual registration with specialized tools is inefficient and costly, automatic registration with visual localization may yield poor results when visual ambiguity exists. To alleviate these issues, we propose a novel solution for jointly mapping an indoor scene and registering CMCs to the scene layout. Our approach involves equipping a mobile agent with a head-mounted RGB-D camera to traverse the entire scene once and synchronize CMCs to capture this mobile agent. The egocentric videos generate world-coordinate agent trajectories and the scene layout, while the videos of CMCs provide pseudo-scale agent trajectories and CMC relative poses. By correlating all the trajectories with their corresponding timestamps, the CMC relative poses can be aligned to the world-coordinate scene layout. Based on this initialization, a factor graph is customized to enable the joint optimization of ego-camera poses, scene layout, and CMC poses. We also develop a new dataset, setting the first benchmark for collaborative scene mapping and CMC registration (https://sites.google.com/view/yowo/home). Experimental results indicate that our method not only effectively accomplishes two tasks within a unified framework, but also jointly enhances their performance. We thus provide a reliable tool to facilitate downstream position-aware applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 54 of its 122 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
54 of 122 references.
References · 54
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
38 more
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 160
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2016End-to-end Learning of Deep Visual Representations for Image Retrievalcited by 122
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2023CIRCLE: Capture In Rich Contextual Environmentscited by 79
- 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
- 2020Robust Image Retrieval-based Visual Localization using Kapturecited by 66
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 48
- 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
- 2021SOLD2: Self-supervised Occlusion-aware Line Description and Detectioncited by 45
- 2020Beyond Controlled Environments: 3D Camera Re-Localization in Changing Indoor Scenescited by 31
- 2018Leveraging Deep Visual Descriptors for Hierarchical Efficient Localizationcited by 29
- 2022Investigating the Role of Image Retrieval for Visual Localization -- An exhaustive benchmarkcited by 27
- 2021MonteFloor: Extending MCTS for Reconstructing Accurate Large-Scale Floor Planscited by 26
- 2021Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Camerascited by 26
- 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
- 2023The 7th AI City Challengecited by 20
- 2016Ego2Top: Matching Viewers in Egocentric and Top-view Videoscited by 17
- 2022Improving Monocular Visual Odometry Using Learned Depthcited by 17
- 2020Pose-Assisted Multi-Camera Collaboration for Active Object Trackingcited by 16
- 2020Predicting Visual Overlap of Images Through Interpretable Non-Metric Box Embeddingscited by 16
- 2021Real-Time Multi-View 3D Human Pose Estimation using Semantic Feedback to Smart Edge Sensorscited by 16
- 2021Wide-Baseline Multi-Camera Calibration using Person Re-Identificationcited by 15
- 2023Proactive Multi-Camera Collaboration For 3D Human Pose Estimationcited by 13
- 2017An Integrated Platform for Live 3D Human Reconstruction and Motion Capturingcited by 12
- 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
- 2022SmartMocap: Joint Estimation of Human and Camera Motion using Uncalibrated RGB Camerascited by 8
- 2016Egocentric Meets Top-viewcited by 7
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models
- 2026From Uncertainty to Determinism: Coarse-to-Fine Visual Floorplan Localization without Ray Matching
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Device
- 2025UMIGen: A Unified Framework for Egocentric Point Cloud Generation and Cross-Embodiment Robotic Imitation Learning
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval
- 2026ActCam: Zero-Shot Joint Camera and 3D Motion Control for Video Generation
- 2026CinemaTraj: Composing Atomic Camera Trajectories for 3D Scenes with LLM Agents