Mapping Hidden Heritage: Self-supervised Pre-training on High-Resolution LiDAR DEM Derivatives for Archaeological Stone Wall Detection
Not on the map. Why?
Abstract (arXiv)
Historic dry-stone walls hold significant cultural and environmental importance, serving as historical markers and contributing to ecosystem preservation and wildfire management during dry seasons in Australia. However, many of these stone structures in remote or vegetated landscapes remain undocumented due to limited accessibility and the high cost of manual mapping. Deep learning-based segmentation offers a scalable approach for automated mapping of such features, but challenges remain: 1.the visual occlusion of low-lying dry-stone walls by dense vegetation and 2.the scarcity of labeled training data. This study presents DINO-CV, a self-supervised cross-view pre-training framework based on knowledge distillation, designed for accurate and data-efficient mapping of dry-stone walls using Digital Elevation Models (DEMs) derived from high-resolution airborne LiDAR. By learning invariant geometric and geomorphic features across DEM-derived views, (i.e., Multi-directional Hillshade and Visualization for Archaeological Topography), DINO-CV addresses the occlusion by vegetation and data scarcity challenges. Applied to the Budj Bim Cultural Landscape at Victoria, Australia, a UNESCO World Heritage site, the approach achieves a mean Intersection over Union (mIoU) of 68.6% on test areas and maintains 63.8% mIoU when fine-tuned with only 10% labeled data. These results demonstrate the potential of self-supervised learning on high-resolution DEM derivatives for large-scale, automated mapping of cultural heritage features in complex and vegetated environments. Beyond archaeology, this approach offers a scalable solution for environmental monitoring and heritage preservation across inaccessible or environmentally sensitive regions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
19 of 48 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2016Wide Residual Networkscited by 3,070
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
7 more
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2019ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed datacited by 261
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2022Self-supervised Vision Transformers for Joint SAR-optical Representation Learningcited by 40
- 2024Impact of LiDAR visualisations on semantic segmentation of archaeological objectscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Identification of Stone Deterioration Patterns with Large Multimodal Models
- 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
- 2025Oitijjo-3D: Generative AI Framework for Rapid 3D Heritage Reconstruction from Street View Imagery
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation
- 2025Distilling Monocular Foundation Model for Fine-grained Depth Completion
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation
- 2025InfraDiffusion: zero-shot depth map restoration with diffusion models and prompted segmentation from sparse infrastructure point clouds
- 2025From Canopy to Ground via ForestGen3D: Learning Cross-Domain Generation of 3D Forest Structure from Aerial-to-Terrestrial LiDAR