Damage detection using in-domain and cross-domain transfer learning
Not on the map. Why?
Abstract (arXiv)
We investigate the capabilities of transfer learning in the area of structural health monitoring. In particular, we are interested in damage detection for concrete structures. Typical image datasets for such problems are relatively small, calling for the transfer of learned representation from a related large-scale dataset. Past efforts of damage detection using images have mainly considered cross-domain transfer learning approaches using pre-trained IMAGENET models that are subsequently fine-tuned for the target task. However, there are rising concerns about the generalizability of IMAGENET representations for specific target domains, such as for visual inspection and medical imaging. We, therefore, evaluate a combination of in-domain and cross-domain transfer learning strategies for damage detection in bridges. We perform comprehensive comparisons to study the impact of cross-domain and in-domain transfer, with various initialization strategies, using six publicly available visual inspection datasets. The pre-trained models are also evaluated for their ability to cope with the extremely low-data regime. We show that the combination of cross-domain and in-domain transfer persistently shows superior performance specially with tiny datasets. Likewise, we also provide visual explanations of predictive models to enable algorithmic transparency and provide insights to experts about the intrinsic decision logic of typically black-box deep models.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 89 references that are in the map. First posted on arXiv 7 Feb 2021.
Builds on
30 of 89 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2014Going Deeper with Convolutionscited by 4,241
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
- 2014How transferable are features in deep neural networks?cited by 1,225
18 more
- 2018Do Better ImageNet Models Transfer Better?cited by 565
- 2018Rethinking ImageNet Pre-trainingcited by 377
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
- 2016What makes ImageNet good for transfer learning?cited by 192
- 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
- 2020On Interpretability of Artificial Neural Networks: A Surveycited by 88
- 2019Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Eracited by 87
- 2020Potential, Challenges and Future Directions for Deep Learning in Prognostics and Health Management Applicationscited by 64
- 2020CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualizationcited by 57
- 2018Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphonecited by 45
- 2019In-domain representation learning for remote sensingcited by 41
- 2020Investigating Transferability in Pretrained Language Modelscited by 28
- 2019Meta-learning Convolutional Neural Architectures for Multi-target Concrete Defect Classification with the COncrete DEfect BRidge IMage Datasetcited by 21
- 2020Road surface detection and differentiation considering surface damagescited by 5
- 2018Bridge Damage Detection using a Single-Stage Detector and Field Inspection Imagescited by 3
- 2018Cross-domain attribute representation based on convolutional neural networkcited by 2
- 2020Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Networkcited by 2
- 2016Learning convolutional neural network to maximize Pos@Top performance measurecited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 3; 2025: 1.
7 papers.
- 2022Building Inspection Toolkit: Unified Evaluation and Strong Baselines for Damage Recognitioncited by 2
- 2023A Novel Strategy for Improving Robustness in Computer Vision Manufacturing Defect Detectioncited by 0
- 2023dacl1k: Real-World Bridge Damage Dataset Putting Open-Source Data to the Testcited by 0
- 2024Analysis of the Two-Step Heterogeneous Transfer Learning for Laryngeal Blood Vessel Classification: Issue and Improvementcited by 0
- 2024Deep Learning for Segmentation of Cracks in High-Resolution Images of Steel Bridgescited by 0
- 2024Instance Segmentation of Reinforced Concrete Bridges with Synthetic Point Cloudscited by 0
- 2025Deep Learning with Self-Attention and Enhanced Preprocessing for Precise Diagnosis of Acute Lymphoblastic Leukemia from Bone Marrow Smears in Hemato-Oncologycited by 0
- 2025Deep Learning with Self-Attention and Enhanced Preprocessing for Precise Diagnosis of Acute Lymphoblastic Leukemia from Bone Marrow Smears in Hemato-Oncology24 Aug 2025
- 2024Instance Segmentation of Reinforced Concrete Bridges with Synthetic Point Clouds24 Sep 2024
- 2024Deep Learning for Segmentation of Cracks in High-Resolution Images of Steel Bridges26 Mar 2024
- 2024Analysis of the Two-Step Heterogeneous Transfer Learning for Laryngeal Blood Vessel Classification: Issue and Improvement29 Feb 2024
- 2023dacl1k: Real-World Bridge Damage Dataset Putting Open-Source Data to the Test7 Sep 2023
- 2023A Novel Strategy for Improving Robustness in Computer Vision Manufacturing Defect Detection16 May 2023
- 2022Building Inspection Toolkit: Unified Evaluation and Strong Baselines for Damage Recognition14 Feb 2022