Deep DIC: Deep Learning-Based Digital Image Correlation for End-to-End Displacement and Strain Measurement
Not on the map. Why?
Abstract (arXiv)
Digital image correlation (DIC) has become an industry standard to retrieve accurate displacement and strain measurement in tensile testing and other material characterization. Though traditional DIC offers a high precision estimation of deformation for general tensile testing cases, the prediction becomes unstable at large deformation or when the speckle patterns start to tear. In addition, traditional DIC requires a long computation time and often produces a low spatial resolution output affected by filtering and speckle pattern quality. To address these challenges, we propose a new deep learning-based DIC approach--Deep DIC, in which two convolutional neural networks, DisplacementNet and StrainNet, are designed to work together for end-to-end prediction of displacements and strains. DisplacementNet predicts the displacement field and adaptively tracks a region of interest. StrainNet predicts the strain field directly from the image input without relying on the displacement prediction, which significantly improves the strain prediction accuracy. A new dataset generation method is developed to synthesize a realistic and comprehensive dataset, including the generation of speckle patterns and the deformation of the speckle image with synthetic displacement fields. Though trained on synthetic datasets only, Deep DIC gives highly consistent and comparable predictions of displacement and strain with those obtained from commercial DIC software for real experiments, while it outperforms commercial software with very robust strain prediction even at large and localized deformation and varied pattern qualities. In addition, Deep DIC is capable of real-time prediction of deformation with a calculation time down to milliseconds.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 11 of its 43 references that are in the map. First posted on arXiv 26 Oct 2021.
Builds on
11 of 43 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2018PS-FCN: A Flexible Learning Framework for Photometric Stereocited by 51
- 2020Optical Flow Estimation in the Deep Learning Agecited by 13
- 2020When Deep Learning Meets Digital Image Correlationcited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 1; 2026: 3.
8 papers.
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2024Asphalt Concrete Characterization Using Digital Image Correlation: A Systematic Review of Best Practices, Applications, and Future Visioncited by 0
- 2024Physics-Informed Neural Network Based Digital Image Correlation Methodcited by 0
- 2025Bayes-DIC Net: Estimating Digital Image Correlation Uncertainty with Bayesian Neural Networkscited by 0
- 2026Quantifying Local Strain Field and Deformation in Active Contraction of Bladder Using a Pretrained Transformer Model: A Speckle-Free Approachcited by 0
- 2026In-situ On-demand Digital Image Correlation: A New Data-rich Characterization Paradigm for Deformation and Damage Development in Solidscited by 0
- 2026Event-based Visual Deformation Measurementcited by 0
- 2026Event-based Visual Deformation Measurement16 Feb 2026
- 2026In-situ On-demand Digital Image Correlation: A New Data-rich Characterization Paradigm for Deformation and Damage Development in Solids24 Jan 2026
- 2026Quantifying Local Strain Field and Deformation in Active Contraction of Bladder Using a Pretrained Transformer Model: A Speckle-Free Approach4 Jan 2026
- 2025Bayes-DIC Net: Estimating Digital Image Correlation Uncertainty with Bayesian Neural Networks3 Dec 2025
- 2024Physics-Informed Neural Network Based Digital Image Correlation Method2 Sep 2024
- 2024Asphalt Concrete Characterization Using Digital Image Correlation: A Systematic Review of Best Practices, Applications, and Future Vision26 Feb 2024
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses11 Jan 2024
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review14 Mar 2023