mlsanityData to 13 Oct 2026

Iterative self-transfer learning: A general methodology for response time-history prediction based on small dataset

arXiv 2306.08700 ↗First posted 14 Jun 2023cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

There are numerous advantages of deep neural network surrogate modeling for response time-history prediction. However, due to the high cost of refined numerical simulations and actual experiments, the lack of data has become an unavoidable bottleneck in practical applications. An iterative self-transfer learningmethod for training neural networks based on small datasets is proposed in this study. A new mapping-based transfer learning network, named as deep adaptation network with three branches for regression (DAN-TR), is proposed. A general iterative network training strategy is developed by coupling DAN-TR and the pseudo-label strategy, and the establishment of corresponding datasets is also discussed. Finally, a complex component is selected as a case study. The results show that the proposed method can improve the model performance by near an order of magnitude on small datasets without the need of external labeled samples,well behaved pre-trainedmodels, additional artificial labeling, and complex physical/mathematical analysis.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 14 Jun 2023.

Builds on

27 of 64 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  3. 2020Language Models are Few-Shot Learnerscited by 32,320
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
  6. 2015Domain-Adversarial Training of Neural Networkscited by 3,030
  7. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,266
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,835
  9. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  10. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,324
  11. 2014How transferable are features in deep neural networks?cited by 1,219
  12. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,058
15 more
  1. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,055
  2. 2016Deep Transfer Learning with Joint Adaptation Networkscited by 609
  3. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
  4. 2016Cross-stitch Networks for Multi-task Learningcited by 466
  5. 2018A Survey on Deep Transfer Learningcited by 417
  6. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 259
  7. 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
  8. 2020MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classificationcited by 186
  9. 2017Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptationcited by 151
  10. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  11. 2019Transfer Learning with Dynamic Adversarial Adaptation Networkcited by 37
  12. 2015Deep Transfer Network: Unsupervised Domain Adaptationcited by 20
  13. 2021Towards Discriminative Representation Learning for Unsupervised Person Re-identificationcited by 20
  14. 2015Contrastive Pessimistic Likelihood Estimation for Semi-Supervised Classificationcited by 6
  15. 2021Supervised Segmentation with Domain Adaptation for Small Sampled Orbital CT Imagescited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.