mlsanityData to 14 Oct 2026

Damage detection using in-domain and cross-domain transfer learning

arXiv 2102.03858 ↗First posted 7 Feb 2021cs.CV cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

We investigate the capabilities of transfer learning in the area of structural health monitoring. In particular, we are interested in damage detection for concrete structures. Typical image datasets for such problems are relatively small, calling for the transfer of learned representation from a related large-scale dataset. Past efforts of damage detection using images have mainly considered cross-domain transfer learning approaches using pre-trained IMAGENET models that are subsequently fine-tuned for the target task. However, there are rising concerns about the generalizability of IMAGENET representations for specific target domains, such as for visual inspection and medical imaging. We, therefore, evaluate a combination of in-domain and cross-domain transfer learning strategies for damage detection in bridges. We perform comprehensive comparisons to study the impact of cross-domain and in-domain transfer, with various initialization strategies, using six publicly available visual inspection datasets. The pre-trained models are also evaluated for their ability to cope with the extremely low-data regime. We show that the combination of cross-domain and in-domain transfer persistently shows superior performance specially with tiny datasets. Likewise, we also provide visual explanations of predictive models to enable algorithmic transparency and provide insights to experts about the intrinsic decision logic of typically black-box deep models.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 89 references that are in the map. First posted on arXiv 7 Feb 2021.

Builds on

30 of 89 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  7. 2014Going Deeper with Convolutionscited by 4,241
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  9. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  10. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
  11. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  12. 2014How transferable are features in deep neural networks?cited by 1,225
18 more
  1. 2018Do Better ImageNet Models Transfer Better?cited by 565
  2. 2018Rethinking ImageNet Pre-trainingcited by 377
  3. 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 368
  4. 2016What makes ImageNet good for transfer learning?cited by 192
  5. 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
  6. 2020On Interpretability of Artificial Neural Networks: A Surveycited by 88
  7. 2019Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Eracited by 87
  8. 2020Potential, Challenges and Future Directions for Deep Learning in Prognostics and Health Management Applicationscited by 64
  9. 2020CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualizationcited by 57
  10. 2018Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphonecited by 45
  11. 2019In-domain representation learning for remote sensingcited by 41
  12. 2020Investigating Transferability in Pretrained Language Modelscited by 28
  13. 2019Meta-learning Convolutional Neural Architectures for Multi-target Concrete Defect Classification with the COncrete DEfect BRidge IMage Datasetcited by 21
  14. 2020Road surface detection and differentiation considering surface damagescited by 5
  15. 2018Bridge Damage Detection using a Single-Stage Detector and Field Inspection Imagescited by 3
  16. 2018Cross-domain attribute representation based on convolutional neural networkcited by 2
  17. 2020Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Networkcited by 2
  18. 2016Learning convolutional neural network to maximize Pos@Top performance measurecited by 1

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 2; 2024: 3; 2025: 1.

7 papers.