Seeing in the Dark: Benchmarking Egocentric 3D Vision with the Oxford Day-and-Night Dataset
Not on the map. Why?
Abstract (arXiv)
We introduce Oxford Day-and-Night, a large-scale, egocentric dataset for novel view synthesis (NVS) and visual relocalisation under challenging lighting conditions. Existing datasets often lack crucial combinations of features such as ground-truth 3D geometry, wide-ranging lighting variation, and full 6DoF motion. Oxford Day-and-Night addresses these gaps by leveraging Meta ARIA glasses to capture egocentric video and applying multi-session SLAM to estimate camera poses, reconstruct 3D point clouds, and align sequences captured under varying lighting conditions, including both day and night. The dataset spans over 30 km of recorded trajectories and covers an area of 40,000 m2, offering a rich foundation for egocentric 3D vision research. It supports two core benchmarks, NVS and relocalisation, providing a unique platform for evaluating models in realistic and diverse environments.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 45 of its 70 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
45 of 70 references.
References · 45
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
33 more
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2020DISK: Learning local features with policy gradientcited by 312
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 225
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 185
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
- 2016End-to-end Learning of Deep Visual Representations for Image Retrievalcited by 122
- 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
- 2020Self-supervising Fine-grained Region Similarities for Large-scale Image Localizationcited by 110
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2016Learning to Navigate the Energy Landscapecited by 62
- 2020The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truthcited by 61
- 2025MegaLoc: One Retrieval to Place Them Allcited by 60
- 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
- 2024GLACE: Global Local Accelerated Coordinate Encodingcited by 48
- 2024Introducing HOT3D: An Egocentric Dataset for 3D Hand and Object Trackingcited by 48
- 2024EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generationcited by 41
- 2024Aria Everyday Activities Datasetcited by 39
- 2021Large-scale Localization Datasets in Crowded Indoor Spacescited by 29
- 2024Splatfacto-W: A Nerfstudio Implementation of Gaussian Splatting for Unconstrained Photo Collectionscited by 28
- 2024The Oxford Spires Dataset: Benchmarking Large-Scale LiDAR-Visual Localisation, Reconstruction and Radiance Field Methodscited by 28
- 2022Hilti-Oxford Dataset: A Millimetre-Accurate Benchmark for Simultaneous Localization and Mappingcited by 23
- 2023BotanicGarden: A High-Quality Dataset for Robot Navigation in Unstructured Natural Environmentscited by 21
- 2025R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localizationcited by 17
- 2024MCD: Diverse Large-Scale Multi-Campus Dataset for Robot Perceptioncited by 16
- 2024FusionPortableV2: A Unified Multi-Sensor Dataset for Generalized SLAM Across Diverse Platforms and Scalable Environmentscited by 15
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmarkcited by 19
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2025Seeing without Pixels: Perception from Camera Trajectoriescited by 4
- 2026ImLoc: Revisiting Visual Localization with Image-based Representationcited by 1
- 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Languagecited by 0
- 2025EgoCampus: Egocentric Pedestrian Eye Gaze Model and Datasetcited by 0
- 2026Accuracy potential of visual localization exploiting high-end street-level imagerycited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labelscited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Accuracy potential of visual localization exploiting high-end street-level imagery27 Jul 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
- 2026ImLoc: Revisiting Visual Localization with Image-based Representation7 Jan 2026
- 2025EgoCampus: Egocentric Pedestrian Eye Gaze Model and Dataset8 Dec 2025
- 2025Seeing without Pixels: Perception from Camera Trajectories26 Nov 2025
- 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Language19 Nov 2025
- 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmark7 Oct 2025